-- Logs begin at Thu 2022-05-12 16:46:54 UTC, end at Thu 2022-05-12 18:03:26 UTC. -- May 12 17:35:59.013800 dv-cinder-840525-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 17:35:59.021939 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 17:35:59.023947 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:35:59 2022] *** May 12 17:35:59.023947 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:35:59.023947 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:35:59.023947 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: nodename: dv-cinder-840525-2-iscsi May 12 17:35:59.023947 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: machine: x86_64 May 12 17:35:59.023947 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: clock source: unix May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: pcre jit disabled May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: detected number of CPU cores: 4 May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: current working directory: / May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: detected binary path: /usr/bin/uwsgi-core May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: your processes number limit is 47680 May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: your memory page size is 4096 bytes May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: detected max file descriptor number: 2048 May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: lock engine: pthread robust mutexes May 12 17:35:59.024419 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: thunder lock: enabled May 12 17:35:59.030431 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 17:35:59.030431 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:35:59.071068 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: Python main interpreter initialized at 0x565173b109c0 May 12 17:35:59.071068 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: python threads support enabled May 12 17:35:59.071068 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: your server socket listen backlog is limited to 100 connections May 12 17:35:59.071068 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: your mercy for graceful operations on workers is 90 seconds May 12 17:35:59.071431 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:35:59.071508 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: *** Operational MODE: preforking *** May 12 17:35:59.071742 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: *** uWSGI is running in multiple interpreter mode *** May 12 17:35:59.071742 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: spawned uWSGI master process (pid: 109175) May 12 17:35:59.071947 dv-cinder-840525-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 17:35:59.072534 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: spawned uWSGI worker 1 (pid: 109176, cores: 1) May 12 17:35:59.072864 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: spawned uWSGI worker 2 (pid: 109177, cores: 1) May 12 17:35:59.073216 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:36:00.267747 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:36:00.274940 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:36:00.999223 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:36:00.999223 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: from cryptography.utils import int_from_bytes May 12 17:36:00.999558 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:36:00.999558 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: from cryptography.utils import int_from_bytes May 12 17:36:00.999771 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:36:00.999771 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: from cryptography.utils import int_from_bytes May 12 17:36:01.000017 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:36:01.000017 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: from cryptography.utils import int_from_bytes May 12 17:36:03.602132 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:36:03.602690 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:36:03.602917 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:36:03.603287 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:36:03.603549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:36:03.603942 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.604308 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.604414 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:36:03.604776 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.604866 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:36:03.604959 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.605201 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:36:03.605297 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.605570 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:36:03.605669 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.605861 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:36:03.605955 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.606234 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.606354 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.606566 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.606674 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.606826 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.606923 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.607149 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.607246 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.607479 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-2-iscsi {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.607588 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.607812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.607909 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.608123 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.608229 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.608466 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.608564 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.608790 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.608881 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.609049 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.609141 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.609370 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.609466 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.609696 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-2-iscsi {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.609790 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.610015 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.610212 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.610374 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.611536 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.611640 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.611720 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.611788 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.611867 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.611935 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612006 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612079 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612154 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612271 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612271 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612408 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612732 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612832 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612908 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.612984 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.613178 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.613283 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.613494 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.613609 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.613886 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614004 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-2-iscsi {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614194 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614307 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614502 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614622 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614818 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.614925 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.615631 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.615726 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.615829 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.615911 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.615989 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-2-iscsi {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616082 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616193 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616302 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616440 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616612 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.616871 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.617106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.617196 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.617436 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.617586 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.617776 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.617880 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.618082 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.618178 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.618387 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.618498 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.618701 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619045 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619268 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619370 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619584 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619680 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619894 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.619980 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.620231 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.620347 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.620523 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.620615 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.620834 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.620922 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.621146 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.621238 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.621510 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.621613 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.621802 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.621986 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.622118 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.622233 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.622373 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.622469 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.622696 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.622784 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623025 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623125 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623340 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623450 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623655 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623753 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.623905 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624039 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624158 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624302 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624501 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624598 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624833 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.624928 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.625145 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.625247 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.625457 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.625554 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.625767 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.625865 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.626077 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.626164 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.626383 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.626476 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.626697 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.626808 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627004 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627100 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627312 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627433 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627634 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627741 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.627949 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.628042 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.628293 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.628403 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.628605 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.628714 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.628926 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629020 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629267 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629368 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629562 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629649 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629872 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.629958 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.630192 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.630288 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.630506 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.630593 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.630813 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.630907 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.631135 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.631231 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.631442 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.631542 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.631698 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.631808 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632007 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632096 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632352 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632440 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632670 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632767 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.632980 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633077 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633286 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633371 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633538 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633635 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633841 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.633936 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.634150 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.634250 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.634465 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.634561 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.634772 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.634858 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635074 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635160 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635385 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635557 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635710 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635849 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.635982 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.636117 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.636290 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.636396 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.636599 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.636687 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.637446 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.637555 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.637778 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.637912 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.638096 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.638229 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.638408 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.638543 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.638722 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.638856 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639033 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639166 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639357 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639488 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639668 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639811 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.639977 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.640121 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.640328 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.640455 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.640642 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.640764 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.640954 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641074 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641276 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641397 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641588 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641698 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641900 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.641987 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.642224 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.642312 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.642529 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.642627 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.642841 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.642942 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.643165 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.643251 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.643477 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.643570 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.643788 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.643883 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.644094 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.644212 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.644422 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.644513 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.644729 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.644824 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645038 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645124 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645348 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645436 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645656 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645749 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.645959 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.646043 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.646263 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.646357 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.646568 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.646655 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.646874 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647011 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647178 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647267 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647482 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647575 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647781 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.647950 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.648098 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.648223 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.648441 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.648530 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.648750 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.648846 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.649057 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.649144 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.649365 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.649452 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.649684 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:36:03.649772 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.650021 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.650109 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.650355 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.650440 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.650690 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.650778 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651005 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651090 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651328 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651421 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651647 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651736 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.651968 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.652065 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.652305 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.652396 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.653255 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.653365 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.653592 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.653737 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.653910 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654008 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654226 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654339 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654542 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654633 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654858 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.654953 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.655182 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.655283 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.655509 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.655602 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.655830 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.655929 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.656143 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.656245 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.656484 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.656577 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.656798 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.656907 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.657118 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.657212 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.657445 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.657532 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.657768 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.657865 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.658080 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.658175 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.658394 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.658489 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.658721 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.658815 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.659052 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.659140 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.659373 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.659458 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.659694 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.659782 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660009 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660096 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660345 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660447 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660661 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660749 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.660977 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.661072 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.661302 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.661395 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.661613 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.661700 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.661931 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662021 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662244 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662339 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662560 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662648 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662872 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.662958 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.663187 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.663276 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.663500 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.663594 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.663817 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.663903 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.664134 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.664302 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.664472 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.664561 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.664785 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.664879 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.665096 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.665197 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.665408 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.665501 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.665717 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.665855 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666125 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666339 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666426 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666649 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666736 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.666957 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667058 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667271 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667368 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667579 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667674 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667892 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.667985 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.668294 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.668432 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.668613 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.668721 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.668946 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.669035 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.669258 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.669384 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.669572 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.669700 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.669886 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.670034 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.670224 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.670356 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.670508 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.670673 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.670822 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671005 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671136 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671319 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671446 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671634 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671771 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.671955 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.672092 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.672304 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.672394 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.672626 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.672725 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.672947 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673052 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673266 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673354 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673597 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673686 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673910 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.673996 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.674224 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.674310 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.674540 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.674674 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.674854 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.674943 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.675186 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.675286 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.675503 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.675602 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.675820 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.675944 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.676144 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.676277 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.676484 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.676578 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.676798 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.676893 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.677108 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.677205 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.677421 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.677511 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.677735 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.677833 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678041 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678140 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678351 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678448 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678655 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678747 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.678964 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679053 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679271 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679365 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679579 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679666 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679884 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.679971 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.680214 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.680304 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.680526 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.680612 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.680833 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.680933 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.681139 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.681227 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.681461 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.681556 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.681772 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.681860 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.682079 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.682163 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.682386 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.682481 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.682693 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.682779 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.683037 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.683123 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.683344 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.683440 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.683677 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.683762 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.684042 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.684233 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.684388 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.684568 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.684710 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.684897 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.685029 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.685224 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.685358 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.685549 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.685678 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.685864 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686005 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686182 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686325 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686500 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686655 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686818 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.686974 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.687142 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.687302 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.687458 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.687613 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.687780 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.687938 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.688094 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.688320 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.688444 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.688664 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.688750 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.688990 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.689077 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.689319 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.689406 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.689637 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.689723 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.689961 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.690046 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.690277 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.690365 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.690596 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.690690 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.690913 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691014 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691225 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691312 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691544 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691632 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691856 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.691956 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.692223 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.692325 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.692503 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.692591 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.692816 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.692912 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.693129 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.693222 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.693442 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.693527 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.693752 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.693847 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.694061 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.694153 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.694384 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.694471 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.694695 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.694791 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695020 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695120 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695327 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695421 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695641 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695730 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.695954 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.696039 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.696311 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.696456 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.696622 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.696763 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.696932 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697071 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697246 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697379 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697561 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697680 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697871 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.697972 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.698184 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.698282 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.698488 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.698582 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.698794 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.698889 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.699105 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.699202 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.699945 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700088 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700268 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700422 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700586 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700697 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700891 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.700979 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.701210 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.701298 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.701521 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.701687 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.701827 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.701915 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.702133 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.702220 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.702447 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.702558 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.702748 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.702844 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703062 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703148 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703375 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703461 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703685 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703772 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.703987 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.704072 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.704314 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.704406 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.704636 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.704723 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.704950 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705105 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705256 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705401 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705546 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705681 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705839 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.705972 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.706174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.706340 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.706475 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.706605 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.706777 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.706925 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.707094 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.707227 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.707413 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.707544 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.707725 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.707824 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.708036 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.708122 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.708369 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.708458 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.708681 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.708781 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709002 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709088 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709315 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709400 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709627 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709722 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.709937 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710025 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710249 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710348 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710558 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710647 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710863 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.710948 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.711179 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.711274 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.711487 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.711581 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.711798 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.712069 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.712157 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.712423 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.712561 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.712734 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.712821 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.713051 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.713139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.713377 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.713616 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.713706 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.713949 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.714035 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.714266 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.714363 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.714584 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.714679 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.714903 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.715001 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.715798 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716202 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716307 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716442 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716531 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716660 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716796 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.716983 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.717103 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.717297 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.717399 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.717610 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.717737 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.717923 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718018 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718242 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718331 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718555 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718642 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718866 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.718953 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.719169 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.719256 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.719479 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.719568 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.719788 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.719875 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.720093 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.720211 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.720422 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.720509 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.720728 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.720815 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721045 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721140 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721350 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721436 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721657 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721751 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.721975 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722070 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722270 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722364 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722583 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722677 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.722983 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.723194 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.723293 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.723499 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.723595 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.723840 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.723935 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.724150 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.724258 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.724507 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.724607 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.724836 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.724930 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.725149 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.725236 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.725461 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.725550 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.725774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.725910 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.726093 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.726183 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.726397 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.726523 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.726703 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.726798 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727009 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727096 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727321 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727418 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727634 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727720 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.727939 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728046 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728272 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728364 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728589 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728731 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728898 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.728995 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.729207 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.729302 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.729513 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.729599 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.729820 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.729913 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.730122 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.730215 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.730436 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.730521 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.730781 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.730880 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.731172 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.731265 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.731482 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.731686 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.731833 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732003 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732189 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732354 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732491 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732669 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.732983 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.733296 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.733615 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.733933 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.734243 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.734574 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.734893 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.735206 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.735519 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.735836 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.736148 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.736480 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.736597 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.736797 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.736963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.737130 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.737300 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.737446 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.737634 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.737779 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.737965 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.738098 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.738350 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.738662 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.738972 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.739168 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.739310 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.739505 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.739647 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.739832 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.739984 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.740193 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.740344 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.740508 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.740653 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.740818 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.740962 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.741142 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.741276 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.741459 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.741601 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.741769 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.741913 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.742081 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.742225 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.742376 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.742514 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.742718 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.742884 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.743021 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.743151 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.743348 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.743481 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.743668 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.744053 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.744249 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.744383 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.744566 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.744711 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.744879 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745029 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745195 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745327 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745503 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745640 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745809 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.745948 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.746121 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.746264 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.746480 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.746647 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.746887 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747054 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747189 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747294 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747490 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747615 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747817 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.747917 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.748137 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.748292 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.748477 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.748567 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.748806 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.748894 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.749141 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.749239 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.749472 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.749566 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.749783 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.749878 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.750099 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.750187 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.750414 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.750500 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.750729 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.750815 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751044 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751133 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751359 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751454 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751665 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751751 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.751979 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.752066 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.752316 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.752406 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.752632 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.752731 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.752941 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753040 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753249 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753336 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753562 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753657 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753876 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.753962 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.754182 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.754269 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.754504 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.754604 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.754817 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.754910 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.755127 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.755214 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.755439 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.755538 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.755747 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.755832 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.756057 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.756181 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.756395 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.756508 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.756703 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.756829 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757017 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757150 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757332 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757470 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757647 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757783 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.757963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.758089 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.758278 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.758409 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.758579 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.758719 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.758889 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.759038 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.759204 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.759354 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.759519 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.759776 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.759872 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.760093 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.760216 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.760436 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.760524 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.760753 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.760840 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.761062 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.761151 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.761367 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.761453 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.761678 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.761764 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.762516 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.762739 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.762812 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.763121 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.763222 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.763429 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.763612 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.763760 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.763937 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.764071 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.764276 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.764424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.764601 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.764849 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.764939 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.765167 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.765256 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.765477 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.765566 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.765832 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.765917 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.766201 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.766286 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.766518 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.766606 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.766846 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.766947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.767170 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.767268 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.767478 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.767574 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.767788 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.767875 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.768102 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.768207 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.768451 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.768551 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.768756 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.768842 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.769065 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.769161 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.769374 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.769461 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.769699 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.769786 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770006 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770100 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770327 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770415 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770652 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770759 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.770971 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.771068 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.771298 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.771401 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.771719 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.771806 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.772049 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.772135 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.772386 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.772492 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.772711 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.772798 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773031 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773345 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773453 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773654 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773748 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.773967 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.774053 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.774278 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.774368 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.774587 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.774673 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.774914 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775001 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775227 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775540 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775626 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775846 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.775932 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.776157 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.776263 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.776490 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.776627 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.776800 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.776887 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.777143 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.777281 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.777441 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.778197 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.778406 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.778559 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.778731 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.778827 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.779059 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.779148 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.779391 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.779487 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.779710 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.779806 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.780019 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.780105 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.780370 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.780472 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.780683 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.780771 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781010 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781097 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781321 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781417 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781635 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781724 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.781951 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782038 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782268 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782364 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782582 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782669 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782889 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.782975 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.783198 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.783287 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.783525 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.783625 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.783832 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.783920 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.784156 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.784264 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.784494 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.784581 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.784820 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.784932 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.785130 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.785218 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.785442 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.785530 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.785758 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.785859 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786069 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786157 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786373 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786459 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786681 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786775 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.786987 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.787074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.787292 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.787378 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.787602 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.787698 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.787913 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788001 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788263 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788357 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788576 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788723 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788904 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.788993 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.789220 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.789307 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.789529 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.789625 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.789846 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.789934 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.790157 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.790245 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.790481 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.790569 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.790791 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.790879 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.791106 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.791202 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.791420 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.791521 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.791726 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.791813 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.792034 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.792121 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.792365 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.792465 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.792677 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.792773 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.793010 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.793156 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.793903 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.793977 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.794124 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.794232 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.794442 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.794580 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.794765 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.794892 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.795088 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.795217 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.795410 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.795532 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.795729 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.795841 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.796050 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.796136 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.796399 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.796503 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.796725 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.796862 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.797088 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.797270 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.797423 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.797602 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.797742 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.797924 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.798067 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.798244 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.798396 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.798563 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.798711 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.798865 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799037 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799187 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799357 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799507 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799676 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799832 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.799995 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.800151 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.800340 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.800494 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.800660 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.800829 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.800979 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.801160 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.801302 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.801494 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.801615 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.801836 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.801923 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.802158 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.802248 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.802479 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.802575 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.802800 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.803069 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.803226 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.803401 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.803490 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.803721 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.803810 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.804039 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.804128 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.804381 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.804473 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.804701 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.804802 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805019 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805109 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805335 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805429 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805648 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805735 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.805962 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.806060 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.806275 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.806363 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.806593 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.806689 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.806914 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807002 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807235 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807330 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807557 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807721 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807878 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.807974 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.808220 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.808331 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.808542 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.808640 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.808905 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.809482 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.809717 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.809866 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.810154 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.810298 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.810476 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.810735 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.810831 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.811059 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.811161 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.811401 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.811489 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.811714 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.811802 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.812030 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.812120 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.812370 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.812470 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.812688 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.812776 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813004 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813093 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813318 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813416 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813636 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813723 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.813951 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.814040 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.814277 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.814431 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.814604 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.814700 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.814927 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815014 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815242 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815329 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815555 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815719 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815872 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.815966 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.816204 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.816418 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.816737 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.816841 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.817074 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.817163 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.817400 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.817487 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.817728 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.817839 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818049 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818144 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818370 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818458 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818683 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818771 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.818991 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.819085 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.819302 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.819389 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.819611 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.819698 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.819923 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820017 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820258 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820349 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820572 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820661 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820885 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.820980 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.821194 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.821281 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.821508 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.821595 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.821818 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.821904 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.822131 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.822355 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.822446 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.822711 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.822797 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823035 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823135 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823352 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823446 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823663 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823751 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.823980 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.824067 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.824317 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.824429 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.824803 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.825142 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.825239 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.825440 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.825612 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.825760 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.825933 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.826072 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.826260 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.826389 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.826582 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.826699 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.826898 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827015 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827214 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827318 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827536 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827632 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827858 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.827959 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.828180 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.828323 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.828522 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.828637 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.828834 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.828932 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.829167 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.829275 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.829479 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.829566 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.829790 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.829879 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.830099 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.830187 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.830415 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.830540 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.830724 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.830810 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.831030 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.831119 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.831343 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.831648 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.831735 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.831961 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.832058 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.832297 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.832390 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.832617 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.832752 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.832924 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833037 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833331 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833541 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833637 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.833951 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.834206 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.834294 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.834556 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.834654 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.834829 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.834926 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.835135 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.835224 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.835449 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.835534 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.835758 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.835855 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.836075 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.836192 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.836416 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.836506 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.836730 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.836824 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837047 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837149 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837377 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837488 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837689 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837908 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.837996 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.838246 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.838334 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.838574 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.838663 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.838907 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.838994 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.839241 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.839329 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.839553 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.839642 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.839860 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.839947 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.840249 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.840429 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.840599 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.840736 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.840867 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841033 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841179 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841282 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841498 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841588 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841813 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.841901 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.842126 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.842224 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.842436 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.842523 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.842746 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.842861 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843058 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843180 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843371 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843509 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843683 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843836 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.843994 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.844154 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.844400 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.844571 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.844717 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.844900 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.845061 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.845219 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.845383 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.845547 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.845703 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.845871 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846022 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846182 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846339 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846528 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846650 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846860 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.846950 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.847191 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.847280 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.847506 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.847607 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.847815 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.847906 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.848126 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.848244 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.848468 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.848627 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.848790 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.848934 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.849106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.849241 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.849418 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.849564 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.849733 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.849868 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850049 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850183 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850365 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850515 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850651 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850790 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.850957 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.851092 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.851266 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.851428 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.851567 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.851704 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.851874 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852009 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852249 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852398 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852537 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852674 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852839 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.852979 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.853126 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.853284 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.853427 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.853581 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.853722 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.853861 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854082 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854216 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854355 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854494 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854631 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854767 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.854922 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.855009 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.855174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.855310 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.855510 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.855612 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.856511 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.856670 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.856827 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.856959 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857056 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857150 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857320 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857410 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857623 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857723 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.857932 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858031 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858239 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858332 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858542 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858630 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858846 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.858949 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.859152 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.859240 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.859455 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.859553 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.859760 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.859848 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.860070 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.860205 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.860398 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.860489 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.860704 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.860793 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861007 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861102 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861313 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861408 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861622 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861711 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.861952 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862041 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862275 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862371 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862590 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862677 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862912 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.862999 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.863223 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.863319 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.863543 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.863631 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.863850 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.863936 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.864185 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.864290 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.864511 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.864598 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.864822 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.864908 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.865133 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.865285 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.865433 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.865590 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.865759 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.865903 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866055 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866193 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866367 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866508 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866681 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866815 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.866994 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.867128 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.867304 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.867439 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.867641 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.867781 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.867959 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.868050 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.868290 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.868381 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.868616 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.868721 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.869200 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.869288 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.869523 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.869611 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.869842 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.869939 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.870155 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.870242 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.870402 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:36:03.870488 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.870785 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.871099 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.872006 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.872352 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.872661 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.872981 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.873300 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.873628 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.873956 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.874284 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.874611 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.874959 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.875274 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.875617 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.875946 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.876312 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.876629 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.876937 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:36:03.877181 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:36:03.894817 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_db.sqlalchemy.engines [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:03.900076 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_db.sqlalchemy.engines [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:03.958166 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.context [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3(cell1) {{(pid=109176) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:36:03.962511 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:36:03.964107 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:36:03.964929 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:36:03.967056 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.context [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3(cell1) {{(pid=109177) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:36:03.967442 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:36:03.971395 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_concurrency.lockutils [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:36:03.973025 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_concurrency.lockutils [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:36:03.973828 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_concurrency.lockutils [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:36:03.975764 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_concurrency.lockutils [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:36:03.978509 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_db.sqlalchemy.engines [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:03.982662 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_db.sqlalchemy.engines [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:03.990083 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_db.sqlalchemy.engines [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:03.993706 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_db.sqlalchemy.engines [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:04.142032 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_db.sqlalchemy.engines [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:04.159722 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG oslo_db.sqlalchemy.engines [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:36:04.486094 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: WARNING keystonemiddleware.auth_token [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:36:04.493490 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: WARNING keystonemiddleware.auth_token [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:36:04.494073 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: WARNING keystonemiddleware.auth_token [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:36:04.501939 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: WARNING keystonemiddleware.auth_token [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:36:04.839725 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: WARNING keystonemiddleware.auth_token [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:36:04.846063 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: WARNING keystonemiddleware.auth_token [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:36:04.852198 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565173b109c0 pid: 109176 (default app) May 12 17:36:04.854266 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:36:04.855453 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 May 12 17:36:04.855891 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Thu May 12 17:36:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:36:04.864107 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: WARNING keystonemiddleware.auth_token [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:36:04.870555 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: WARNING keystonemiddleware.auth_token [None req-bb55010d-cf4d-499b-acca-bb6b6e472ab5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:36:04.877005 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x565173b109c0 pid: 109177 (default app) May 12 17:37:23.284838 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:23.285853 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 12 17:37:23.286252 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:23.704225 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-ce9b31b5-775a-48b6-b18f-e31a97713ab7 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:23.736327 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-ce9b31b5-775a-48b6-b18f-e31a97713ab7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.441402 May 12 17:37:23.744253 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1291 bytes} [Thu May 12 17:37:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:37:26.025011 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:26.026037 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-be9a7f0c-5614-4658-b3f2-2c643709b8a4 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 12 17:37:26.027171 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:26.086299 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-e25c9551-13f3-41b3-9655-8effa0bd31fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "ram": 256, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:26.105190 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:37:26.105190 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: warnings.warn(msg) May 12 17:37:26.140636 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-e25c9551-13f3-41b3-9655-8effa0bd31fe admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107636 May 12 17:37:26.141313 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:26.356579 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-c971b3b1-7e65-4e65-920e-da7990a8a2bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:26.358989 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:37:26.358989 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: warnings.warn(msg) May 12 17:37:26.407032 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-c971b3b1-7e65-4e65-920e-da7990a8a2bb admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257510 May 12 17:37:26.408104 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1335 bytes} [Thu May 12 17:37:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:37:28.704184 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-e25c9551-13f3-41b3-9655-8effa0bd31fe admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:28.705212 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-e25c9551-13f3-41b3-9655-8effa0bd31fe admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 12 17:37:28.705620 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:28.824808 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-1a3079fa-2ed4-4e6a-bc44-6b1ab9e47594 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:28.842818 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:37:28.842818 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: warnings.warn(msg) May 12 17:37:28.862804 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-1a3079fa-2ed4-4e6a-bc44-6b1ab9e47594 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150795 May 12 17:37:28.863565 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:28.876128 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-f438a4d0-421c-4f2d-940a-fc45b11d6908 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:28.877745 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:37:28.877745 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: warnings.warn(msg) May 12 17:37:28.915528 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-f438a4d0-421c-4f2d-940a-fc45b11d6908 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043016 May 12 17:37:28.916111 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1335 bytes} [Thu May 12 17:37:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:37:31.215981 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-1a3079fa-2ed4-4e6a-bc44-6b1ab9e47594 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:31.217055 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-1a3079fa-2ed4-4e6a-bc44-6b1ab9e47594 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 12 17:37:31.217459 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:31.275540 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-cfca44df-7652-45eb-b691-4d03aba1a9b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "id": "d2", "disk": 10}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:31.294932 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-cfca44df-7652-45eb-b691-4d03aba1a9b8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071589 May 12 17:37:31.295669 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:31.307321 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-a6e68718-f436-43a1-8a69-8fdb5b16087b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:31.337553 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-a6e68718-f436-43a1-8a69-8fdb5b16087b admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033920 May 12 17:37:31.339379 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1335 bytes} [Thu May 12 17:37:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:37:33.613523 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-cfca44df-7652-45eb-b691-4d03aba1a9b8 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:33.614549 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-cfca44df-7652-45eb-b691-4d03aba1a9b8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 12 17:37:33.615165 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:33.685497 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-a2e6c3b0-6838-4c75-846f-9d48b718bcc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:33.708909 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-a2e6c3b0-6838-4c75-846f-9d48b718bcc3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087035 May 12 17:37:33.709735 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:33.723495 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-97c029fc-6276-4d66-a38a-cd43b8005ba9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:33.755796 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-97c029fc-6276-4d66-a38a-cd43b8005ba9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036162 May 12 17:37:33.756457 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1335 bytes} [Thu May 12 17:37:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:37:36.041523 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-a2e6c3b0-6838-4c75-846f-9d48b718bcc3 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:36.042891 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-a2e6c3b0-6838-4c75-846f-9d48b718bcc3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 12 17:37:36.043310 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:36.103135 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-c628cced-42b3-4ae1-ac83-87969ceddeee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "disk": 20}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:36.122258 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-c628cced-42b3-4ae1-ac83-87969ceddeee admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073140 May 12 17:37:36.122818 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:36.134544 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-095dcbc3-7319-489c-8a24-5db03c56055a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:36.159585 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-095dcbc3-7319-489c-8a24-5db03c56055a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028678 May 12 17:37:36.160183 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1335 bytes} [Thu May 12 17:37:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:37:38.472398 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-c628cced-42b3-4ae1-ac83-87969ceddeee admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:38.473414 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-c628cced-42b3-4ae1-ac83-87969ceddeee admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 12 17:37:38.473821 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:38.534047 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-a1ef3034-8dc7-4b16-8e9b-94676074f9b2 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:38.558711 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-a1ef3034-8dc7-4b16-8e9b-94676074f9b2 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078489 May 12 17:37:38.559303 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1291 bytes} [Thu May 12 17:37:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:37:40.879473 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-c628cced-42b3-4ae1-ac83-87969ceddeee admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:40.880873 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-c628cced-42b3-4ae1-ac83-87969ceddeee admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 May 12 17:37:40.881461 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:40.942392 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-d81fb461-1b0e-4e35-8b26-443ff2231fbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:40.960451 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-d81fb461-1b0e-4e35-8b26-443ff2231fbe admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071218 May 12 17:37:40.960998 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:37:40.977058 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-1517bd54-a1e5-422b-831c-664227068aa2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:41.006809 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-1517bd54-a1e5-422b-831c-664227068aa2 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034636 May 12 17:37:41.007700 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1332 bytes} [Thu May 12 17:37:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:37:43.394665 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-d81fb461-1b0e-4e35-8b26-443ff2231fbe admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:43.395677 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-d81fb461-1b0e-4e35-8b26-443ff2231fbe admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 12 17:37:43.396089 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:43.459780 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-6850237a-301e-44fc-9e1d-008ac07e94a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "name": "m1.small", "vcpus": 1, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:43.478482 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-6850237a-301e-44fc-9e1d-008ac07e94a4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075994 May 12 17:37:43.479106 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:37:43.492389 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-41eabad9-93c9-41b5-a0e5-d2e496f50fe6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:43.516100 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-41eabad9-93c9-41b5-a0e5-d2e496f50fe6 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027769 May 12 17:37:43.516743 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1332 bytes} [Thu May 12 17:37:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:37:46.076147 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-6850237a-301e-44fc-9e1d-008ac07e94a4 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:46.077213 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-6850237a-301e-44fc-9e1d-008ac07e94a4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 12 17:37:46.077620 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:46.165090 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-18d10e8d-81c3-4537-95a2-9cdae5c57489 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "3", "name": "m1.medium", "swap": 0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:46.184871 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-18d10e8d-81c3-4537-95a2-9cdae5c57489 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.101241 May 12 17:37:46.185405 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:37:46.198585 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-fdc9c136-bd0c-4112-acb7-6cfc96b87d2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:46.222884 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-fdc9c136-bd0c-4112-acb7-6cfc96b87d2c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029276 May 12 17:37:46.223473 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1332 bytes} [Thu May 12 17:37:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:37:48.576878 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-18d10e8d-81c3-4537-95a2-9cdae5c57489 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:48.577845 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-18d10e8d-81c3-4537-95a2-9cdae5c57489 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 12 17:37:48.578249 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:48.638587 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-72579b30-7912-449c-87d8-3e8a3d07989a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "name": "m1.large", "id": "4"}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:48.655698 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-72579b30-7912-449c-87d8-3e8a3d07989a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071723 May 12 17:37:48.656480 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:48.668710 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-8223dece-7222-4651-a76f-248b84b46829 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:48.692252 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-8223dece-7222-4651-a76f-248b84b46829 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027829 May 12 17:37:48.702711 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1332 bytes} [Thu May 12 17:37:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:37:50.970473 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-72579b30-7912-449c-87d8-3e8a3d07989a admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:37:50.972222 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-72579b30-7912-449c-87d8-3e8a3d07989a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 May 12 17:37:50.972828 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:37:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:37:51.032949 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-1aba34b8-6935-4d75-817c-2dc22d911fb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:51.054334 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-1aba34b8-6935-4d75-817c-2dc22d911fb5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075746 May 12 17:37:51.054890 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1282 bytes} [Thu May 12 17:37:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:37:51.067514 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-d046ccb2-c79c-4e78-8652-4db5c89bc81c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:37:51.093687 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-d046ccb2-c79c-4e78-8652-4db5c89bc81c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030221 May 12 17:37:51.094616 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1332 bytes} [Thu May 12 17:37:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:38:15.570272 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-1aba34b8-6935-4d75-817c-2dc22d911fb5 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:15.571300 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-1aba34b8-6935-4d75-817c-2dc22d911fb5 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 12 17:38:15.571706 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:15.628845 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-8221943e-d514-4c5f-a328-96828fb57c81 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:15.646374 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-8221943e-d514-4c5f-a328-96828fb57c81 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068499 May 12 17:38:15.646899 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1291 bytes} [Thu May 12 17:38:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:38:16.655946 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-1aba34b8-6935-4d75-817c-2dc22d911fb5 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:16.656993 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-1aba34b8-6935-4d75-817c-2dc22d911fb5 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 12 17:38:16.657399 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:16.868435 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-98c86c6c-318a-49d6-9282-dbd8e1fcd951 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:16.874892 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.wsgi [None req-98c86c6c-318a-49d6-9282-dbd8e1fcd951 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-98c86c6c-318a-49d6-9282-dbd8e1fcd951 admin admin] Request method failure captured: May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Accept: application/json May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Accept-Encoding: gzip, deflate May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Connection: keep-alive May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Content-Length: 0 May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Host: 10.222.0.73 May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Openstack-Api-Version: compute 2.90 May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Openstack-System-Scope: None May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: User-Agent: python-novaclient May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Auth-Token: gAAAAABifUYITs_4TsipOyMomKtzi60KcA5Wu1s5_8n38Ft-7C4WJGtc9vsZjolKDj6HnYlNON6oGaJ0muFFOS9suz7NtOTCUcUVZDDJH9pAzzvhvKazAwOysTqJ7C3JYAazdnS0TLvGc2-kLF3aCm8N-hhSj9etfdBzG_6q3mK368REkYyvJaI May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Domain-Id: None May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Domain-Name: None May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Identity-Status: Confirmed May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Is-Admin-Project: True May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Domain-Id: default May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Domain-Name: Default May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Name: admin May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Role: admin,reader,member May 12 17:38:16.878127 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Roles: admin,reader,member May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccf7092b8d0b4d6a9522dc9ba6d91833", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant: admin May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant-Name: admin May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User: admin May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Domain-Id: default May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Domain-Name: Default May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Id: 254e338acf294dff9fffc87141257a5d May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Name: admin May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: method: > May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: exception: Flavor 42 could not be found. May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: action_args: {'id': '42'} May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:38:16.879774 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:16.880812 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:16.881963 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-98c86c6c-318a-49d6-9282-dbd8e1fcd951 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:38:16.883032 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-98c86c6c-318a-49d6-9282-dbd8e1fcd951 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063774 May 12 17:38:16.883032 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1190 bytes} [Thu May 12 17:38:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:38:16.889458 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-0b88ebb3-e565-4881-9dd3-40fdc19a9cf9 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:16.911318 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-0b88ebb3-e565-4881-9dd3-40fdc19a9cf9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025539 May 12 17:38:16.911901 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1210 bytes} [Thu May 12 17:38:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:38:16.922268 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-34d0abdd-dce0-4361-bb01-0181cc465267 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:16.944472 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-34d0abdd-dce0-4361-bb01-0181cc465267 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025771 May 12 17:38:16.945047 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1210 bytes} [Thu May 12 17:38:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:38:16.954607 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-48c32d6b-9917-4583-b87c-a0fc0abbca1b admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:16.960119 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.wsgi [None req-48c32d6b-9917-4583-b87c-a0fc0abbca1b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-48c32d6b-9917-4583-b87c-a0fc0abbca1b admin admin] Request method failure captured: May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Accept: application/json May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Accept-Encoding: gzip, deflate May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Connection: keep-alive May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Content-Length: 0 May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Host: 10.222.0.73 May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Openstack-Api-Version: compute 2.90 May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Openstack-System-Scope: None May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: User-Agent: python-novaclient May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Auth-Token: gAAAAABifUYITs_4TsipOyMomKtzi60KcA5Wu1s5_8n38Ft-7C4WJGtc9vsZjolKDj6HnYlNON6oGaJ0muFFOS9suz7NtOTCUcUVZDDJH9pAzzvhvKazAwOysTqJ7C3JYAazdnS0TLvGc2-kLF3aCm8N-hhSj9etfdBzG_6q3mK368REkYyvJaI May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Domain-Id: None May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Domain-Name: None May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Identity-Status: Confirmed May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Is-Admin-Project: True May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Domain-Id: default May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Domain-Name: Default May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Name: admin May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Role: admin,reader,member May 12 17:38:16.963424 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Roles: admin,reader,member May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccf7092b8d0b4d6a9522dc9ba6d91833", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant: admin May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant-Name: admin May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User: admin May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Domain-Id: default May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Domain-Name: Default May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Id: 254e338acf294dff9fffc87141257a5d May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Name: admin May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: method: > May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: exception: Flavor 42 could not be found. May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: action_args: {'id': '42'} May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:38:16.965315 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:16.966106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:16.967139 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-48c32d6b-9917-4583-b87c-a0fc0abbca1b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:38:16.968122 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-48c32d6b-9917-4583-b87c-a0fc0abbca1b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013880 May 12 17:38:16.968122 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1190 bytes} [Thu May 12 17:38:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:38:17.849072 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-34d0abdd-dce0-4361-bb01-0181cc465267 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:17.850088 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-34d0abdd-dce0-4361-bb01-0181cc465267 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 12 17:38:17.850493 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:18.043835 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-d1c2fd44-87e8-4b65-84c7-e0155ce821ea admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:18.049056 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.wsgi [None req-d1c2fd44-87e8-4b65-84c7-e0155ce821ea admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-d1c2fd44-87e8-4b65-84c7-e0155ce821ea admin admin] Request method failure captured: May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Accept: application/json May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Accept-Encoding: gzip, deflate May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Connection: keep-alive May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Content-Length: 0 May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Host: 10.222.0.73 May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Openstack-Api-Version: compute 2.90 May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Openstack-System-Scope: None May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: User-Agent: python-novaclient May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Auth-Token: gAAAAABifUYJ18aOEQ3Wqi8k1DynjUxuhQa8aWGmGAqpXAFUnFq4HSfv_nYd3QoZ6WkeZ9KgK0PC8qThnAiTxhiH7HUX44nKA_npiBsZ7-nGRSZgEdNSaXpdCsfCJ3nMQiocbgwjL5FF5X8SmTwt_l4IoQxPAlyD3KK9S9gPpIEFHpL2KDvuw-U May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Domain-Id: None May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Domain-Name: None May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Identity-Status: Confirmed May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Is-Admin-Project: True May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Domain-Id: default May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Domain-Name: Default May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Name: admin May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Role: admin,reader,member May 12 17:38:18.050549 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Roles: admin,reader,member May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccf7092b8d0b4d6a9522dc9ba6d91833", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant: admin May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant-Name: admin May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User: admin May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Domain-Id: default May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Domain-Name: Default May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Id: 254e338acf294dff9fffc87141257a5d May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Name: admin May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: method: > May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: exception: Flavor 84 could not be found. May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: action_args: {'id': '84'} May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:38:18.052074 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:18.053086 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:18.054469 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-d1c2fd44-87e8-4b65-84c7-e0155ce821ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:38:18.056236 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-d1c2fd44-87e8-4b65-84c7-e0155ce821ea admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060182 May 12 17:38:18.056236 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1190 bytes} [Thu May 12 17:38:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:38:18.061941 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-3af198c1-24ef-4d63-a148-171da304a8c8 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:18.075933 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-3af198c1-24ef-4d63-a148-171da304a8c8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017556 May 12 17:38:18.076499 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1210 bytes} [Thu May 12 17:38:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:38:18.085658 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-8d3065e0-e2f8-480c-8faa-c16c6bf9f705 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:18.099715 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-8d3065e0-e2f8-480c-8faa-c16c6bf9f705 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017534 May 12 17:38:18.100439 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1210 bytes} [Thu May 12 17:38:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:38:18.110236 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-f8d064a7-784e-41b0-8e53-fa742876d2dc admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:18.115313 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.wsgi [None req-f8d064a7-784e-41b0-8e53-fa742876d2dc admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-f8d064a7-784e-41b0-8e53-fa742876d2dc admin admin] Request method failure captured: May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Accept: application/json May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Accept-Encoding: gzip, deflate May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Connection: keep-alive May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Content-Length: 0 May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Host: 10.222.0.73 May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Openstack-Api-Version: compute 2.90 May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Openstack-System-Scope: None May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: User-Agent: python-novaclient May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Auth-Token: gAAAAABifUYJ18aOEQ3Wqi8k1DynjUxuhQa8aWGmGAqpXAFUnFq4HSfv_nYd3QoZ6WkeZ9KgK0PC8qThnAiTxhiH7HUX44nKA_npiBsZ7-nGRSZgEdNSaXpdCsfCJ3nMQiocbgwjL5FF5X8SmTwt_l4IoQxPAlyD3KK9S9gPpIEFHpL2KDvuw-U May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Domain-Id: None May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Domain-Name: None May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Identity-Status: Confirmed May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Is-Admin-Project: True May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Domain-Id: default May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Domain-Name: Default May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Name: admin May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Role: admin,reader,member May 12 17:38:18.116853 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Roles: admin,reader,member May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccf7092b8d0b4d6a9522dc9ba6d91833", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant: admin May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant-Name: admin May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User: admin May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Domain-Id: default May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Domain-Name: Default May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Id: 254e338acf294dff9fffc87141257a5d May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Name: admin May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: method: > May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: exception: Flavor 84 could not be found. May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: action_args: {'id': '84'} May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:38:18.118234 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:18.119028 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:18.120947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-f8d064a7-784e-41b0-8e53-fa742876d2dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:38:18.122302 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-f8d064a7-784e-41b0-8e53-fa742876d2dc admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011510 May 12 17:38:18.122302 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1190 bytes} [Thu May 12 17:38:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 17:38:19.026934 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-8d3065e0-e2f8-480c-8faa-c16c6bf9f705 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:19.027925 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-8d3065e0-e2f8-480c-8faa-c16c6bf9f705 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 12 17:38:19.028345 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:38:19.221615 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-2e5b4ed8-675d-47c5-b3e5-78dbf93e0596 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:19.227169 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.wsgi [None req-2e5b4ed8-675d-47c5-b3e5-78dbf93e0596 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-2e5b4ed8-675d-47c5-b3e5-78dbf93e0596 admin admin] Request method failure captured: May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Accept: application/json May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Accept-Encoding: gzip, deflate May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Connection: keep-alive May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Content-Length: 0 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Host: 10.222.0.73 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Openstack-Api-Version: compute 2.90 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Openstack-System-Scope: None May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: User-Agent: python-novaclient May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Auth-Token: gAAAAABifUYLWvYU9nhCnD5c4fO24RGhhspAZiEGy08zDgs9o2tknJqOxFrYQHmiF6-g-ltgm0h9YWSAuKwa65_0TUzObIoDIQccZtTbu3AeaU9ZAgWbq-Bu1elraZg3ERBolPDBclg0jaFQb9oIl-2i738xeP9hLhenBWRiziJdQDbpzbMxgw4 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Domain-Id: None May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Domain-Name: None May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Identity-Status: Confirmed May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Is-Admin-Project: True May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Domain-Id: default May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Domain-Name: Default May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Project-Name: admin May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Role: admin,reader,member May 12 17:38:19.228685 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Roles: admin,reader,member May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccf7092b8d0b4d6a9522dc9ba6d91833", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant: admin May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-Tenant-Name: admin May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User: admin May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Domain-Id: default May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Domain-Name: Default May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Id: 254e338acf294dff9fffc87141257a5d May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: X-User-Name: admin May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: method: > May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: exception: Flavor 451 could not be found. May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: action_args: {'id': '451'} May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:38:19.230888 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:19.231863 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: ERROR nova.api.openstack.wsgi May 12 17:38:19.233237 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-2e5b4ed8-675d-47c5-b3e5-78dbf93e0596 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:38:19.234591 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-2e5b4ed8-675d-47c5-b3e5-78dbf93e0596 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060533 May 12 17:38:19.234591 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1193 bytes} [Thu May 12 17:38:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:38:19.240490 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-a2877f5c-4755-42d4-a497-d32503a5015d admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:19.254894 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-a2877f5c-4755-42d4-a497-d32503a5015d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017982 May 12 17:38:19.255417 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1210 bytes} [Thu May 12 17:38:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:38:19.264720 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:19.278607 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017356 May 12 17:38:19.279155 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1210 bytes} [Thu May 12 17:38:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:38:19.288263 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-0753df23-abd0-4bc7-836c-c626cfeb8811 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:19.294257 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.wsgi [None req-0753df23-abd0-4bc7-836c-c626cfeb8811 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-0753df23-abd0-4bc7-836c-c626cfeb8811 admin admin] Request method failure captured: May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Accept: application/json May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Accept-Encoding: gzip, deflate May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Connection: keep-alive May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Content-Length: 0 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Host: 10.222.0.73 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Openstack-Api-Version: compute 2.90 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Openstack-System-Scope: None May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: User-Agent: python-novaclient May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Auth-Token: gAAAAABifUYLWvYU9nhCnD5c4fO24RGhhspAZiEGy08zDgs9o2tknJqOxFrYQHmiF6-g-ltgm0h9YWSAuKwa65_0TUzObIoDIQccZtTbu3AeaU9ZAgWbq-Bu1elraZg3ERBolPDBclg0jaFQb9oIl-2i738xeP9hLhenBWRiziJdQDbpzbMxgw4 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Domain-Id: None May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Domain-Name: None May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Identity-Status: Confirmed May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Is-Admin-Project: True May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Openstack-Nova-Api-Version: 2.90 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Domain-Id: default May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Domain-Name: Default May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Project-Name: admin May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Role: admin,reader,member May 12 17:38:19.295774 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Roles: admin,reader,member May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccf7092b8d0b4d6a9522dc9ba6d91833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccf7092b8d0b4d6a9522dc9ba6d91833", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant: admin May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant-Id: ccf7092b8d0b4d6a9522dc9ba6d91833 May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-Tenant-Name: admin May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User: admin May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Domain-Id: default May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Domain-Name: Default May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Id: 254e338acf294dff9fffc87141257a5d May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: X-User-Name: admin May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: method: > May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: exception: Flavor 451 could not be found. May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: action_args: {'id': '451'} May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:38:19.297228 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:19.298174 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: ERROR nova.api.openstack.wsgi May 12 17:38:19.299548 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-0753df23-abd0-4bc7-836c-c626cfeb8811 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:38:19.300907 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-0753df23-abd0-4bc7-836c-c626cfeb8811 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012444 May 12 17:38:19.300907 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1193 bytes} [Thu May 12 17:38:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 17:38:20.181385 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:20.182804 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 17:38:20.183233 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:20.374418 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-8d4a1048-ac7d-4ab6-ad24-5d58556c5eca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:38:20.392096 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-8d4a1048-ac7d-4ab6-ad24-5d58556c5eca admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068006 May 12 17:38:20.392588 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1235 bytes} [Thu May 12 17:38:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:38:21.287084 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:21.288081 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 12 17:38:21.288515 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:21.474718 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-aa1d06d7-8dfa-4ce5-bd81-44e07043b0f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:38:21.492208 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-aa1d06d7-8dfa-4ce5-bd81-44e07043b0f6 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066830 May 12 17:38:21.492752 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1235 bytes} [Thu May 12 17:38:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:38:22.465251 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:22.466423 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 May 12 17:38:22.466896 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:22.657776 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-5992581b-e217-4bf3-bfc9-2c34f2c65c1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:38:22.675373 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-5992581b-e217-4bf3-bfc9-2c34f2c65c1f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069516 May 12 17:38:22.675853 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1235 bytes} [Thu May 12 17:38:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:38:23.568032 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:23.569061 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 12 17:38:23.569454 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:23.763876 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-ff2a6f3c-0083-4431-9d3e-cd00552c7b37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:38:23.781429 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-ff2a6f3c-0083-4431-9d3e-cd00552c7b37 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070177 May 12 17:38:23.781896 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1235 bytes} [Thu May 12 17:38:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:38:24.679072 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:24.680074 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 May 12 17:38:24.680504 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:38:24.868067 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-09e0ba3b-30a7-4a5c-8ad5-f3d1c81f573f admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:38:24.888575 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-09e0ba3b-30a7-4a5c-8ad5-f3d1c81f573f admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073079 May 12 17:38:24.889114 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1202 bytes} [Thu May 12 17:38:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:39:26.963905 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:39:26.964947 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-505baf5e-30e3-4a1f-a272-60a51f13a2f3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 May 12 17:39:26.965345 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 930 bytes} [Thu May 12 17:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:39:27.036151 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-9342f3ef-42ea-4bb4-bbd0-5bacf4b67c55 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:39:27.056105 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-9342f3ef-42ea-4bb4-bbd0-5bacf4b67c55 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.084910 May 12 17:39:27.056668 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1291 bytes} [Thu May 12 17:39:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:39:27.078830 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-4388d338-1817-42e4-887f-d94735e0fd26 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:39:27.086259 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-4388d338-1817-42e4-887f-d94735e0fd26 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011715 May 12 17:39:27.086772 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1282 bytes} [Thu May 12 17:39:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:39:27.098299 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-268d467c-1551-4554-988c-3d6a54b85bb6 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:39:27.106275 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-268d467c-1551-4554-988c-3d6a54b85bb6 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011514 May 12 17:39:27.106787 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1285 bytes} [Thu May 12 17:39:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:39:27.117645 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:39:27.125331 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011181 May 12 17:39:27.125845 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1285 bytes} [Thu May 12 17:39:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:39:27.137355 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-f18631cd-d376-486a-a761-9b5e6a69a639 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:39:27.144680 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-f18631cd-d376-486a-a761-9b5e6a69a639 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011427 May 12 17:39:27.145198 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1282 bytes} [Thu May 12 17:39:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:42:50.205341 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:50.206381 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 12 17:42:50.206776 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:42:50.471878 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-5cf55fbc-11a2-4983-bba0-bcb67fcd4704 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:50.473106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:50.473106 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: warnings.warn(msg) May 12 17:42:50.474282 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-5cf55fbc-11a2-4983-bba0-bcb67fcd4704 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:50.474714 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-5cf55fbc-11a2-4983-bba0-bcb67fcd4704 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:50.475488 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-5cf55fbc-11a2-4983-bba0-bcb67fcd4704 admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:50.475910 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-5cf55fbc-11a2-4983-bba0-bcb67fcd4704 admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:50.507953 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-5cf55fbc-11a2-4983-bba0-bcb67fcd4704 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145367 May 12 17:42:50.508541 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1193 bytes} [Thu May 12 17:42:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:42:51.423967 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:51.425009 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 12 17:42:51.425552 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 35/71] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:42:51.617950 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-ab74f7ee-4ecf-4623-8e40-93c5213d4e7c admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:42:51.619125 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:51.619125 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: warnings.warn(msg) May 12 17:42:51.620418 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-ab74f7ee-4ecf-4623-8e40-93c5213d4e7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:51.620867 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-ab74f7ee-4ecf-4623-8e40-93c5213d4e7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:51.622563 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-ab74f7ee-4ecf-4623-8e40-93c5213d4e7c admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:42:51.622997 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-ab74f7ee-4ecf-4623-8e40-93c5213d4e7c admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:42:51.642318 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-ab74f7ee-4ecf-4623-8e40-93c5213d4e7c admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076805 May 12 17:42:51.642814 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1193 bytes} [Thu May 12 17:42:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:43:02.965658 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:02.967327 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 May 12 17:43:02.967751 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 36/73] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:43:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:03.161737 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-dc8df4fd-57e1-48b0-a2ac-76c9e3ab53fa admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:03.162904 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:43:03.162904 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: warnings.warn(msg) May 12 17:43:03.164114 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-dc8df4fd-57e1-48b0-a2ac-76c9e3ab53fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.164590 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-dc8df4fd-57e1-48b0-a2ac-76c9e3ab53fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.165371 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-dc8df4fd-57e1-48b0-a2ac-76c9e3ab53fa admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:03.165799 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-dc8df4fd-57e1-48b0-a2ac-76c9e3ab53fa admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:03.190262 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-dc8df4fd-57e1-48b0-a2ac-76c9e3ab53fa admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083852 May 12 17:43:03.190734 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1193 bytes} [Thu May 12 17:43:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:43:04.123426 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: DEBUG nova.api.openstack.wsgi [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] Calling method '>' {{(pid=109177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:04.124455 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: INFO nova.api.openstack.requestlog [None req-75e466a4-3feb-46de-aae8-b828a4b23b64 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 12 17:43:04.124857 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: [pid: 109177|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1074 bytes} [Thu May 12 17:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:43:04.314845 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG nova.api.openstack.wsgi [None req-bb3ef700-08b8-497f-b58a-3f1f51fd0ed0 admin admin] Calling method '>' {{(pid=109176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:43:04.316047 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:43:04.316047 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: warnings.warn(msg) May 12 17:43:04.317251 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-bb3ef700-08b8-497f-b58a-3f1f51fd0ed0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.317696 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-bb3ef700-08b8-497f-b58a-3f1f51fd0ed0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.318481 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-bb3ef700-08b8-497f-b58a-3f1f51fd0ed0 admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:43:04.318910 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: DEBUG oslo_concurrency.lockutils [None req-bb3ef700-08b8-497f-b58a-3f1f51fd0ed0 admin admin] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:43:04.341274 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: INFO nova.api.openstack.requestlog [None req-bb3ef700-08b8-497f-b58a-3f1f51fd0ed0 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076702 May 12 17:43:04.341765 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: [pid: 109176|app: 0|req: 39/76] 10.222.0.73 () {60 vars in 1193 bytes} [Thu May 12 17:43:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:44:03.805879 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: Thu May 12 17:44:03 2022 - graceful shutdown triggered... May 12 17:44:03.806407 dv-cinder-840525-2-iscsi devstack@n-api.service[109176]: Gracefully killing worker 1 (pid: 109176)... May 12 17:44:03.806959 dv-cinder-840525-2-iscsi devstack@n-api.service[109177]: Gracefully killing worker 2 (pid: 109177)... May 12 17:44:03.808274 dv-cinder-840525-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 17:44:04.806995 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: worker 1 buried after 1 seconds May 12 17:44:04.806995 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: worker 2 buried after 1 seconds May 12 17:44:04.806995 dv-cinder-840525-2-iscsi devstack@n-api.service[109175]: goodbye to uWSGI. May 12 17:44:04.808621 dv-cinder-840525-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 17:44:04.809215 dv-cinder-840525-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 17:44:04.811868 dv-cinder-840525-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 17:44:04.827014 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:44:04 2022] *** May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: nodename: dv-cinder-840525-2-iscsi May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: machine: x86_64 May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: clock source: unix May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: pcre jit disabled May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: detected number of CPU cores: 4 May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: current working directory: / May 12 17:44:04.845435 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: detected binary path: /usr/bin/uwsgi-core May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: your processes number limit is 47680 May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: your memory page size is 4096 bytes May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: detected max file descriptor number: 2048 May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: lock engine: pthread robust mutexes May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: thunder lock: enabled May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 17:44:04.846154 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:44:04.894582 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: Python main interpreter initialized at 0x563f3bc559c0 May 12 17:44:04.894582 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: python threads support enabled May 12 17:44:04.894582 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: your server socket listen backlog is limited to 100 connections May 12 17:44:04.894582 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: your mercy for graceful operations on workers is 90 seconds May 12 17:44:04.895012 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:44:04.895012 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: *** Operational MODE: preforking *** May 12 17:44:04.895198 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: *** uWSGI is running in multiple interpreter mode *** May 12 17:44:04.895198 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: spawned uWSGI master process (pid: 123502) May 12 17:44:04.895414 dv-cinder-840525-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 17:44:04.896025 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: spawned uWSGI worker 1 (pid: 123519, cores: 1) May 12 17:44:04.896858 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: spawned uWSGI worker 2 (pid: 123520, cores: 1) May 12 17:44:04.896858 dv-cinder-840525-2-iscsi devstack@n-api.service[123502]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:44:06.120439 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:44:06.122680 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 17:44:06.941027 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:44:06.941027 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: from cryptography.utils import int_from_bytes May 12 17:44:06.941334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:44:06.941334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: from cryptography.utils import int_from_bytes May 12 17:44:06.943092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:44:06.943092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: from cryptography.utils import int_from_bytes May 12 17:44:06.943418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:44:06.943418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: from cryptography.utils import int_from_bytes May 12 17:44:09.399684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:44:09.400513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:44:09.400513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:44:09.400794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:44:09.401064 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:44:09.401463 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.401796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.403157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.403157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.403157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.403157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.403500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.403705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.404046 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.404351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.404675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.405010 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-2-iscsi {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.405341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.406191 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.406520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.406847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.407164 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.407499 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.407817 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.408354 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.409811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.409811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.409811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.409811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.410151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.410380 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.410691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.411063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.411391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.411682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.412065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-2-iscsi {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.412418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.412743 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.413055 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.413474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.413797 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.414111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.414446 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.414760 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.415257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.415479 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.415738 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.416068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.416427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.416745 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.417063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.417383 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.417713 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.418032 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.418351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.418612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.418931 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.419262 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.419595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.419927 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.420201 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.420466 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.420796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.421188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.422028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.422349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.422666 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.422980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.423294 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.423614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.423930 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.424276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.424610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.424937 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.425270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.425588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.425917 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.426331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.426597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.426910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.427262 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.427590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.427910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.428259 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.428591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.428908 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.429223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.429537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.429865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.430200 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.430515 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.430805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.431087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.431401 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.431731 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.432047 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.432389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.432705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.433015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.433332 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.433654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.433966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.434280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.434595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.434912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.435228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.435542 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.435855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.436195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.436529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.436893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.437209 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.437680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.437987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.438376 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.438626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.438941 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.439272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.439588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.439902 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.440252 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.440572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.440887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.441216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.441528 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.441844 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.442171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.442488 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.442804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.443117 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.443430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.443747 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.444061 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.444415 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.444728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.445036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.445364 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.445693 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.446013 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.446328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.446644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.446974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.447312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.447648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.448064 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.448333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.448671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.449010 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.449335 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.449655 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.449979 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.450314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.450634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.450954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.451122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:44:09.451602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.451752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:44:09.451906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.452059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:44:09.452228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.452407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:44:09.452553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.453622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:44:09.453814 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.453964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.454115 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.454268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.454411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.454554 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.454778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.454926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.455070 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.455221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.455372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.455526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.455681 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.455836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.455980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.456134 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.456312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.456471 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.456471 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.456856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.457025 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.457244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.457486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-2-iscsi {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.457671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.458052 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.458304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.458456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.458627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.458881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.459045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.459191 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.459341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.459485 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.459635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.459787 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.459931 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.460080 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.460290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.460290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.460597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.460802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.460958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.461116 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.461262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.461404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.461556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.461701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.461850 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.462001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.462155 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.462307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.462461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.462604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.462770 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.462922 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.463076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.464093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.464309 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.464458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.464602 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.464744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.464895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-2-iscsi {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.465067 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.465219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.465364 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.465513 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.465656 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.465807 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.465959 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.465959 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.466230 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.466382 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.466536 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.466688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.466851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.467091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.467259 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.467502 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.467719 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.468684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.468866 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.469250 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.469412 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.469599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.469761 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.469923 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.470068 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.470224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.470381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.470532 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.470691 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.470843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.470998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.470998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.471278 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.471429 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.471581 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.471737 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.471880 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.472030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.472210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.472380 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.472535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.472688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.472839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.472989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.473133 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.473288 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.473441 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.473593 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.473742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.473893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.474057 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.474214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.474367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.474511 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.474662 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.474817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.474962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.475118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.475269 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.475413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.475555 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.475699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.475860 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.476004 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.476147 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.476326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.476326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.476598 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.476749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.476894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.477059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.477288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.477438 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.477696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.477929 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.478090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.478241 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.478384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.478834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.478991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.479150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.479398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.479550 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.479701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.479845 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.479998 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.480151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.480359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.480533 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.480692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.480843 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.480990 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.481142 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.481299 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.481443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.481586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.481728 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.481869 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.482025 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.482177 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.482330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.482474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.482617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.482758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.482914 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.483058 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.483202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.483344 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.483502 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.484303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.484627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.484822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.484980 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.485143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.485290 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.485439 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.485596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.485749 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.485899 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.486042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.486195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.486353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.486496 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.486646 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.486790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.486943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.487096 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.487266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.487531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.487531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.487927 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.488145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.488359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.488521 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.488683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.489150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.489296 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.489557 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.489709 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.489879 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.490031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.490175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.490324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.490468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.490626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.490778 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.490928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.491083 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.491236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.491387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.491545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.491698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.491698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.491997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.492148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.492317 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.492461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.492616 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.492769 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.492921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.493072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.493226 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.493370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.493513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.493656 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.493822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.493967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.494110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.494260 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.494403 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.494553 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.494706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.494850 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.495001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.495194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.495365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.495520 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.495683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.495836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.495979 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.496128 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.496309 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.496468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.496613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.496764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.496909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.497059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.497209 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.497361 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.497841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.498088 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.498332 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.498482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.498632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.498786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.498786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.499436 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.499688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.499848 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.500009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.500154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.500333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.500478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.500658 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.500807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.500975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.501131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.501275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:44:09.501418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.501561 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.501736 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.501982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502135 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502135 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.502996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.503142 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.503285 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.503428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.503580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.503732 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.503884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.504122 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.504376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.504376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.504687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.504833 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.504983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.505127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.505278 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.505428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.505581 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.505725 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.505867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506161 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506470 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506632 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506776 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.506928 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.507072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.507225 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.507377 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.507520 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.507669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.507831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.508068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.508335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.508557 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.508716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.508881 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.509250 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.509510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.509676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.509830 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.509999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.512791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.512985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.513151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.513313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.513469 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.513625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.513783 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.513928 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.514081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.514226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.514380 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.514531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.514684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.514881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515041 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515193 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515352 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515498 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.515965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.516116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.516297 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.516451 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.516595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.516739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.516896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.517048 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.517198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.517342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.517484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.517710 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.517875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.518046 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.518298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.518538 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.518758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.518919 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.519071 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.519450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.519725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.519887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.519887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.520351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.520515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.520677 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.520839 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521002 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521636 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.521952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.522112 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.522271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.522422 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.522586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.522736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.522736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523343 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523493 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523802 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.523950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.524271 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.524433 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.524603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.524761 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.524912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525061 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525535 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.525990 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.526148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.526307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.526466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.526634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.526785 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.526933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.527089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.527254 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.527412 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.527562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.527711 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.527867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.528018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.528196 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.528444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.528696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.529000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.529168 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.529354 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.529750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.529998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.530155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.530305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.531110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.531287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.531447 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.531600 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.531745 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.531906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532058 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532235 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532673 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532816 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.532972 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.533125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.533275 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.533417 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.533560 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.533709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.533882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534185 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534336 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534479 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.534929 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535644 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.535956 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.536114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.536288 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.536450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.536609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.536767 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.536925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.537075 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.537231 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.537395 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.537545 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.537695 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.537862 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.538026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.538177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.538388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.538641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.538883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.539120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.539275 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.539434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.539816 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.539816 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.540309 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.540482 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.540642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.540793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.540953 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.541123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.541369 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.541589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.541745 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.541912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.542070 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.542228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.542386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.542536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.542704 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.542863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543021 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543172 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543470 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.543948 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.544108 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.544295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.544448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.544597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.544766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.544916 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.545074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.545224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.545381 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.545539 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.545695 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.545853 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.546036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.546804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.546969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.547125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.547270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.547432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.547577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.547726 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.547877 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.548030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.548202 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.548364 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.548655 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.548923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.549078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.549522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.549704 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.550061 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.550256 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.550501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.550668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.550821 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.550970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.551127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.551289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.551582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.551754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.551906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552077 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552480 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552633 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.552943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.553236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.553387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.553547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.553705 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.553865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554332 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554655 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.554953 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.555103 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.555253 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.555410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.555562 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.555711 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.555861 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556666 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.556965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.557153 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.557323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.557481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.557633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.557784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.557940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.558101 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.558253 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.558402 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.558561 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.558729 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.558973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.559216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.559398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.559636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.559801 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.560200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.560200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.560539 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.560786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.560951 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.561120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.561293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.561453 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.562254 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.562426 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.562586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.562746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.562973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.563146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.563298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.563456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.563606 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.563756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.563926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.564091 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.564301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.564463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.564614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.564764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.564914 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565233 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565384 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.565819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.566281 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.566445 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.566602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.566767 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.566925 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.567238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.567398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.567559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.567717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.567878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.568029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.568221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.568221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.568525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.568676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.568835 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.569074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.569323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.569482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.569651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.569872 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.570255 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.570413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.570583 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.570734 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.570991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.571168 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.571323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.571474 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.571631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.571810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.572061 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.572305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.572481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.572633 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.572793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.572962 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.573121 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.573287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.573440 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.573591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.573749 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.573901 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.574060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.574225 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.574385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.574543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.574694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.574844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575013 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575852 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.575852 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.576147 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.576357 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.576519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.576684 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.576835 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.576993 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.577162 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.577414 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.578165 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.578372 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.578372 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.578672 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.578824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.578975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.579234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.579477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.579637 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.579796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.580043 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.580858 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.581064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.581313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.581479 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.581639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.581793 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.581944 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.582222 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.582222 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.582528 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.582680 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.582839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583015 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583168 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583324 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.583957 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.586177 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.586375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.586539 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.586696 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.586851 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.587082 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.587250 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.587411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.587572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.587725 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.587874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.588040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.588266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.588428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.588590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.588742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.588906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.589067 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.589255 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.589505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.589737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.589896 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.590081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.590333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.590333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.590729 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.591029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.591197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.591465 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.591627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.591787 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.591950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.592100 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.592367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.592540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.592700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.592851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593053 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593376 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593536 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.593996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.594166 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.594329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.594483 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.594641 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.594838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.594838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.595148 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.595383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.595537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.595696 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.595855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596006 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596179 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596362 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.596832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.597141 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.597300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.597452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.597610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.597768 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.597926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.598087 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.598239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.598399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.598558 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.598716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.598867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.599030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.600660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.600660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.600660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.600660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.601462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.601710 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.601710 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.602020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.602171 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.602336 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.602631 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.602798 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.602958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.603122 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.603273 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.603437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.603596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.603596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.603902 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.604055 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.604236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.605089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.605264 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.605432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.605604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.605764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.605918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.606076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.606235 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.606396 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.606549 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.606699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.606850 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607161 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.607960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.608127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.608318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.608471 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.609216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.609451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.609621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.609889 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.610145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.610303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.610465 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.610744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.610991 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.611527 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.611725 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.611992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.612214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.612389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.612550 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.612859 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.613019 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.613172 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.613330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.613492 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.613664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.613855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614317 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614785 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.614971 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.615133 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.615285 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.615449 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.615614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.615773 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.615925 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.616729 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.616887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.617094 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.617268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.617430 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.617581 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.617741 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.617893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618042 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618511 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618606 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618703 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618798 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618885 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.618970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619055 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619055 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619220 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619756 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619981 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.619981 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.620389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.620503 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.620601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.620705 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.620804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.620904 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621276 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621725 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.621932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.622036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.622130 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.622224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.622324 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.622675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.622768 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623086 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.623882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.624046 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.624205 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.624342 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.624945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625132 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625219 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625401 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625659 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.625846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626124 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626300 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626470 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626555 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626649 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.626916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627192 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627466 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627659 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.627923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.628660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.629924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.629924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.629924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630156 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630616 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630702 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630796 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.630984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.631591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632558 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632746 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632840 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632840 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.632840 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633269 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633378 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633565 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633565 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633565 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633889 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.633889 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634130 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634560 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634647 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634647 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.634906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635317 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635565 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635650 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635743 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635839 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.635839 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636004 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636258 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.636891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637122 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.637876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638678 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638678 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638678 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.638924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639177 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639578 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.639891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.640118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.640411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.640663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.640811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.640916 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.641127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.641373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.641482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.641737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.641983 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.642099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.642227 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.642428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.642669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.642794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643405 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643504 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643662 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.643981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.644066 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.644349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.644451 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.644676 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.644760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645729 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.645957 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.646040 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.646272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.646353 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.646590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.646681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.646911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.647569 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.647893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.648126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.648245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.648525 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.648624 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.648834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.648974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.649165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.649280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.649486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.649577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.649845 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.649945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.650125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.650232 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.650444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.650545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.650800 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.650898 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.651072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.651175 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.651393 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.651531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.651712 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.651822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.652035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.652157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.652393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.652477 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.652727 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.652810 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.653053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.653140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.653683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.653795 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.653884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.653980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.654079 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.654272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.654604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.654708 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.654924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.655025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.655261 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.655357 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.655616 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.655719 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.655946 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.656123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.656307 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.656494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.656633 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.656824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.656965 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.657153 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.657280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.657478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.657580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.657804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.657905 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.658129 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.658224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.658454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.658548 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.658777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.658870 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.659113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.659207 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.659403 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.659505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.659721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.659828 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.660030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.660129 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.660375 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.660607 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.660700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.660958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.661061 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.661278 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.661379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.661605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.661698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.661938 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662258 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662661 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662894 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.662988 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.663204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.663305 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.663514 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.663618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.663832 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.663933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.664144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.664267 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.664494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.664602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.664803 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.664904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.665116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.665244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.665426 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.665570 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.665731 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.665902 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666042 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666559 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.666993 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.667226 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.667333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.667534 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.667635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.667847 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.667948 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.668152 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.668351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.668484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.668587 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.668791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.668886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.669096 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.669200 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.669411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.669505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.669718 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.669820 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670028 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670332 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670426 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670643 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670736 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.670950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.671557 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.671780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.672059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.672407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.672510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.672608 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.672704 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.672792 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.673029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.673125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.673349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.673451 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.673663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.673756 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674243 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674346 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.674903 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.675003 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.675219 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.675306 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.675535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.675769 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.675870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.676113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.676245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.676467 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.676569 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.676783 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.676883 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.677098 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.677194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.677413 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.677506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.677726 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.677820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678130 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678345 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678446 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678668 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678761 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.678984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.679078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.679297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.679398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.679611 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.679703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.679926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680575 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680685 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.680982 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.681199 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.681294 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.681510 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.681612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.681822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.681916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.682134 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.682236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.682455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.682557 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.682782 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.682882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.683102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.683202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.683418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.683519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.683735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.683835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.684050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.684143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.684401 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.684497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.684716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.684819 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.685996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.686089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.686310 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.686432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.686619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.686809 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.687584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.687693 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.687790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.688011 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.688115 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.688362 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.688473 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.688687 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.688792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689103 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689649 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.689960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.690056 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.690284 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.690393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.690596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.690691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.690926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.691020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.691267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.691380 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.691599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.691692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.691924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.692025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.692260 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.692375 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.692572 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.692666 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.692880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.693036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.693193 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.693290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.693457 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:44:09.693550 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.693813 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.694120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.694425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.694736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.695040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.695345 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.695651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.695958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.696318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.696639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.696945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.697249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.697552 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.697856 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.698161 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.698469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.698772 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.699077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.699379 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.699680 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.699982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.700339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.700675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.700990 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.701314 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.701625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.701945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.702279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.702622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.702945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.703261 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.703572 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.703902 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.704242 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.704560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.704872 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.705183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.705493 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.705804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.706129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.706456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.706763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.707088 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.707405 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.707728 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.708046 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.708382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.708715 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.709028 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.709337 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.709652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.709963 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.710274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.710590 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.710906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.711233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.711559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.711929 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.712232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.712584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.712933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.713242 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.713575 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.713905 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.714204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.714521 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:44:09.714764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:44:09.717539 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.738217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.782905 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.context [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3(cell1) {{(pid=123520) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:44:09.787306 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:09.788928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:09.789754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:09.791687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:09.802179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.context [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3(cell1) {{(pid=123519) load_cells /opt/stack/nova/nova/context.py:464}} May 12 17:44:09.803611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.805883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.806638 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:09.808251 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:09.809105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:44:09.811044 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:44:09.824602 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.826424 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.967116 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_db.sqlalchemy.engines [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:09.984863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_db.sqlalchemy.engines [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:44:10.292831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:44:10.301284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:44:10.323024 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:44:10.333000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:44:10.672197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:44:10.678427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: WARNING keystonemiddleware.auth_token [None req-fbcb938e-cd32-4647-81f8-4c1e3e349425 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:44:10.683828 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f3bc559c0 pid: 123520 (default app) May 12 17:44:10.752074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 17:44:10.758326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: WARNING keystonemiddleware.auth_token [None req-8739763a-1931-41e5-894f-8cb5fbf85a2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 17:44:10.763680 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563f3bc559c0 pid: 123519 (default app) May 12 17:44:53.535822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c4c70e08-72ff-4422-8ca4-c1b1fd6249dc tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Action: 'create', calling method: .version_select at 0x7fc0c8133280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-273509458", "metadata": {"Type": "work"}}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:55.675201 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c4c70e08-72ff-4422-8ca4-c1b1fd6249dc tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.437748 May 12 17:44:55.676153 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1155 bytes} [Thu May 12 17:44:52 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3440 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 17:44:55.691944 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-775a8674-107c-4525-bc9c-c73abc7f87ee tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Calling method '.version_select at 0x7fc0c7f8c280>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:55.866888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-775a8674-107c-4525-bc9c-c73abc7f87ee tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580" status: 200 len: 352 microversion: 2.1 time: 0.182300 May 12 17:44:55.868734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 2/2] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:44:55 2022] GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:44:56.794333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2020025296", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "networks": [{"uuid": "bbada9e4-5d7c-41fd-b37b-17edbfab514e"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:44:56.881450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4fc75c41-48e9-4b84-aa7e-8e5c173bfd7e tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Calling method '.version_select at 0x7fc0c7f8c4c0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:56.977183 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4fc75c41-48e9-4b84-aa7e-8e5c173bfd7e tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580" status: 200 len: 353 microversion: 2.1 time: 0.099556 May 12 17:44:56.978323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 3/3] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:44:56.990918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4ed322f6-27f9-41e4-9e2c-df66e1c61245 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Calling method '.version_select at 0x7fc0c7f8c9d0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.147224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4ed322f6-27f9-41e4-9e2c-df66e1c61245 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580" status: 200 len: 353 microversion: 2.1 time: 0.159945 May 12 17:44:57.160051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 4/4] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:44:56 2022] GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:57.166289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2cb7d994-6b66-4dff-9f86-f8f284f5b8c2 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Calling method '.version_select at 0x7fc0c7f960d0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.314280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2cb7d994-6b66-4dff-9f86-f8f284f5b8c2 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580" status: 202 len: 0 microversion: 2.1 time: 0.152392 May 12 17:44:57.318268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 5/5] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:44:57 2022] DELETE /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:44:57.323018 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-384ad140-d182-47b6-8265-4cd7324ae766 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Calling method '.version_select at 0x7fc0c7f8cd30>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:57.335622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] validate_networks() for [('bbada9e4-5d7c-41fd-b37b-17edbfab514e', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:44:57.392489 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-384ad140-d182-47b6-8265-4cd7324ae766 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580" status: 200 len: 352 microversion: 2.1 time: 0.073004 May 12 17:44:57.393353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 6/6] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:44:57 2022] GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:44:58.406035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-64189ca4-596c-4a2e-8032-c4e22150cf10 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Calling method '.version_select at 0x7fc0c7f8c0d0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:44:58.450126 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-64189ca4-596c-4a2e-8032-c4e22150cf10 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] HTTP exception thrown: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-64189ca4-596c-4a2e-8032-c4e22150cf10 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Request method failure captured: May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 HTTP/1.1 May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeUziKMYQ8aTrX7aY9_L3MfdD8rn5tCYgi5Pe3afAAqR7trqWTFR6pq1Sfo0yA8rSDSwNBMH4on06nWjuB6CW4x9k1hx6ISdKbBcBUzcvRyX4aJF6SVv07geRFAj36JFrToYPOT9e3wMmq1K9ldhO84uLIo_-C-eHtU4PQbaQve8RY May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 53cc45c6ac3e48a7aa2041ffd965d3db May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesGetTestJSON-1058112851 May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:44:58.455300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/53cc45c6ac3e48a7aa2041ffd965d3db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/53cc45c6ac3e48a7aa2041ffd965d3db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/53cc45c6ac3e48a7aa2041ffd965d3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_53cc45c6ac3e48a7aa2041ffd965d3db", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesGetTestJSON-1058112851 May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 53cc45c6ac3e48a7aa2041ffd965d3db May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesGetTestJSON-1058112851 May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesGetTestJSON-1058112851-project May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 57026d850c044b578bcb991e03b76aee May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesGetTestJSON-1058112851-project May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '57c6e969-4839-418c-ae13-7c0067634580'} May 12 17:44:58.456978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. (HTTP 404) (Request-ID: req-5c810d65-946b-450d-9357-622c7105ac6c) May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:44:58.458125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:44:58.459626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:44:58.461107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. May 12 17:44:58.462590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:44:58.466151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-64189ca4-596c-4a2e-8032-c4e22150cf10 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] Returning 404 to user: Volume 57c6e969-4839-418c-ae13-7c0067634580 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:44:58.466151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-64189ca4-596c-4a2e-8032-c4e22150cf10 tempest-VolumesGetTestJSON-1058112851 tempest-VolumesGetTestJSON-1058112851-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580" status: 404 len: 109 microversion: 2.1 time: 0.064266 May 12 17:44:58.467634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 7/7] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:44:58 2022] GET /compute/v2.1/os-volumes/57c6e969-4839-418c-ae13-7c0067634580 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:45:00.011815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:00.012339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:00.012752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:00.013221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:00.013805 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:00.060714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.063592 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.065018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:00.065476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:00.152563 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Getting quotas for project 4a12890be016462ea430af4ff0080553. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:00.177041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Getting quotas for user b00b6242e52a4ab1bc98280fe7242647 and project 4a12890be016462ea430af4ff0080553. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:00.212490 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:00.220406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:00.408512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-23483d96-8237-4abe-b9e3-40f091b4dceb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.827604 May 12 17:45:00.409168 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 1/8] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:00.420086 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ab6708d2-7e20-43b5-8059-3ea9c2194a35 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:00.421470 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ab6708d2-7e20-43b5-8059-3ea9c2194a35 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:00.645556 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ab6708d2-7e20-43b5-8059-3ea9c2194a35 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:00.669661 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ab6708d2-7e20-43b5-8059-3ea9c2194a35 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1215 microversion: 2.1 time: 0.253945 May 12 17:45:00.673452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 8/9] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:00 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:01.690585 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-28365f18-5837-4b4e-a67b-3f027ab9f31b tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:01.691787 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-28365f18-5837-4b4e-a67b-3f027ab9f31b tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:01.877996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-28365f18-5837-4b4e-a67b-3f027ab9f31b tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:01.901416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-28365f18-5837-4b4e-a67b-3f027ab9f31b tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1215 microversion: 2.1 time: 0.215098 May 12 17:45:01.904388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 2/10] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:01 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:02.922739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:02.923693 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:02.941241 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.945123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:02.946178 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:02.950948 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:03.384961 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:03.403090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3db9d232-060a-4921-af9f-43ba4e11f3e6 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1219 microversion: 2.1 time: 0.484308 May 12 17:45:03.412244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 9/11] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:02 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1219 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:04.424064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:04.429252 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:04.450200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.450662 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:04.451511 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:04.453876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:05.153628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:05.183144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c0000d56-dc4f-44c7-80c8-191edbde246a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1267 microversion: 2.1 time: 0.761881 May 12 17:45:05.186416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 3/12] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:04 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1267 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:06.204706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:06.207879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:06.229784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.230388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:06.237003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:06.237677 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:07.095372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:07.120909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ab172fa9-6fc1-4c55-99c3-6cea39e90773 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1273 microversion: 2.1 time: 0.915771 May 12 17:45:07.122068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 10/13] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:06 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1273 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:08.140145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:08.140834 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:08.164050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.171767 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.181109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:08.183009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:08.602093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:08.620030 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-57ce1145-2bed-4260-88ee-3ea21690f6ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1273 microversion: 2.1 time: 0.484211 May 12 17:45:08.626440 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 11/14] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:08 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1273 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:08.838049 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5f379dba-6df8-4ee2-901a-08db5c2717e4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'create', calling method: .version_select at 0x7fc0c6e63a60>, body: {"keypair": {"name": "tempest-keypair-2039870651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPg6rCm1U1wb3giZKVjOSTaC4l2dZgbizMPa7RDILLDTuPS8+UULaZ8lWD8Az4TaOSklT4NcNozCCmJ6ZuCP9k7QWwJ8OZGw/jjLP/mGBWaXBxAZ/PtVXMZZ7xt08JRAA=="}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:08.946373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-5f379dba-6df8-4ee2-901a-08db5c2717e4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:08.971136 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-5f379dba-6df8-4ee2-901a-08db5c2717e4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for user 7a2b51125e9645dc9454042f49ff3659 and project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:09.072250 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5f379dba-6df8-4ee2-901a-08db5c2717e4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.370947 May 12 17:45:09.073854 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 4/15] 10.222.0.73 () {62 vars in 1199 bytes} [Thu May 12 17:45:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1374 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 17:45:09.643216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:09.644481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:09.666960 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.667414 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:09.668287 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:09.668733 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:11.161995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:11.182149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a8adffb5-99c5-4d01-b7d4-0a78b7701eb7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 1.541328 May 12 17:45:11.188862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 12/16] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:09 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:11.505648 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1426825816", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:11.631698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] validate_networks() for [('dae508b5-33ae-47fd-88cd-96de0b50f763', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:12.205982 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:12.206602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:12.231991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.238020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:12.242932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:12.244775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.173014 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:13.202867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-428127e6-e3e1-426b-b0a9-31652634463c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 1.001477 May 12 17:45:13.203875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 13/17] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:12 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:13.648597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:13.649104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:13.650032 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:13.650454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:13.650875 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:13.677064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.678531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.679447 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:13.679895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:13.753225 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for project 202db80dae2446e2b9cd1124b2925ced. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:13.765864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for user 298a13924a864f61adf6e4085e569358 and project 202db80dae2446e2b9cd1124b2925ced. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:13.789911 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:13.797376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:14.089187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-69d17161-9cc2-4503-a5b8-fb09d666699a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.755656 May 12 17:45:14.091342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 5/18] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:45:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:14.113311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-090688c8-6886-4a13-998b-db83fb074fb3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: .version_select at 0x7fc0c7ec4430>, body: {"keypair": {"name": "tempest-keypair-1702367950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3f6x/OpuUj56KusIrrGdDhdedY6tZQQ+8r8oYSbzJ4czgHyGmkKNhuP9wkOXO8xr3hmyZXbOqf4jFCupsYn9M20oQgVqkTRIPs0UhiKL2befQ4HlyyNeIz8BqUZc/Lww=="}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:14.133318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-556a8db0-ae92-4cec-8c34-96bb12f75fca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:14.133979 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-556a8db0-ae92-4cec-8c34-96bb12f75fca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:14.274336 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-090688c8-6886-4a13-998b-db83fb074fb3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:14.291277 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-090688c8-6886-4a13-998b-db83fb074fb3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:14.413119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-090688c8-6886-4a13-998b-db83fb074fb3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.207565 May 12 17:45:14.417800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 14/19] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:45:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:14.423205 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-556a8db0-ae92-4cec-8c34-96bb12f75fca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:14.430346 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:14.432739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-556a8db0-ae92-4cec-8c34-96bb12f75fca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1222 microversion: 2.1 time: 0.326427 May 12 17:45:14.448004 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:14.450759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 6/20] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:14 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:14.455870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.461390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.472491 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:14.486000 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:14.750386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1690309622", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:14.903854 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] validate_networks() for [('dae508b5-33ae-47fd-88cd-96de0b50f763', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:15.640625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:15.670618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2f0607a7-63dc-4475-8afb-72238c85b478 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 1.242500 May 12 17:45:15.671503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 15/21] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:14 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:15.972513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7c14c0d8-5129-4c58-941b-45926d7dcb09 req-b21801a0-dfcc-47a8-a4f8-72aead550931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee0ce63-2c3a-49c2-bb05-03cee02949ad", "tag": "cd1d9d90-b454-463a-9a54-8dd81303eda8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:15.998812 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7c14c0d8-5129-4c58-941b-45926d7dcb09 req-b21801a0-dfcc-47a8-a4f8-72aead550931 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:15.999536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7c14c0d8-5129-4c58-941b-45926d7dcb09 req-b21801a0-dfcc-47a8-a4f8-72aead550931 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.049995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7c14c0d8-5129-4c58-941b-45926d7dcb09 req-b21801a0-dfcc-47a8-a4f8-72aead550931 service nova] Creating event network-changed:cd1d9d90-b454-463a-9a54-8dd81303eda8 for instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad on hv-cinder-84052 May 12 17:45:16.050714 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7c14c0d8-5129-4c58-941b-45926d7dcb09 req-b21801a0-dfcc-47a8-a4f8-72aead550931 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 17:45:16.054291 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.055453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.057558 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:16.058693 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:16.071905 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.compute.rpcapi [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 17:45:16.073603 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] Releasing lock "compute-rpcapi-router" {{(pid=123520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 17:45:16.114652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b0ce2e07-d3c8-499d-887c-90a58007d45a None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441559 May 12 17:45:16.115887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 16/22] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:16.124393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1400029462", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4a1943f-5104-4c36-90a4-e3e9daad3559"}], "security_groups": [{"name": "tempest-securitygroup--1819449083"}], "key_name": "tempest-keypair-2039870651", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:17.047885 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] validate_networks() for [('a4a1943f-5104-4c36-90a4-e3e9daad3559', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:17.903177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:17.903754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:17.905103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:17.905722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:17.906326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:17.929688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.934117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:17.937222 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:17.947775 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.015714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for project 202db80dae2446e2b9cd1124b2925ced. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:18.047062 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for user 298a13924a864f61adf6e4085e569358 and project 202db80dae2446e2b9cd1124b2925ced. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:18.096396 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:18.098815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:18.314122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-153d54f3-56a3-4856-9135-dcbeb672a721 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.569313 May 12 17:45:18.319297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 7/23] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:45:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:18.338295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:18.341772 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:18.382381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.388275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:18.390492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:18.391147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.502079 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.510604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a4a98e8e-ee30-42c4-bb20-3b465e36dc29 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 1.189769 May 12 17:45:19.526064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 8/24] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:18 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:19.532110 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:19.547916 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:19.559298 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.568134 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.569593 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:19.570305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:19.851693 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:19.886788 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-50100861-8f25-4cb4-8de8-11f2089edc7a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1226 microversion: 2.1 time: 0.362541 May 12 17:45:19.893351 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 9/25] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:19 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1226 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:20.347171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:20.348290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:20.349450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:20.349918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:20.350370 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:20.399853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.401119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.402292 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.403611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.499989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:20.517625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for user 7a2b51125e9645dc9454042f49ff3659 and project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:20.534663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:20.535288 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:20.554062 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.557411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.560151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:20.562181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:20.575212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:20.585734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:20.774420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-95d7360f-e471-4a16-8f16-b59528aa6f26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.656255 May 12 17:45:20.775087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 17/26] 10.222.0.73 () {62 vars in 1187 bytes} [Thu May 12 17:45:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 4658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 17:45:20.785664 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cbc40960-d097-42ea-ad47-0aeaac99c90f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:20.805787 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cbc40960-d097-42ea-ad47-0aeaac99c90f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:21.062855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cbc40960-d097-42ea-ad47-0aeaac99c90f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.080271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cbc40960-d097-42ea-ad47-0aeaac99c90f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.082505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cbc40960-d097-42ea-ad47-0aeaac99c90f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.096460 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.101464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cbc40960-d097-42ea-ad47-0aeaac99c90f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1282 microversion: 2.20 time: 0.319753 May 12 17:45:21.112612 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9c62b3f3-78ac-471b-aefb-3ced1de47ade tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.577018 May 12 17:45:21.115131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 10/28] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:20 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:21.115447 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 18/28] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:20 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:21.130744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:21.135224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:21.151734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.152219 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.153205 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:21.153957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:21.435432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:21.463996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2389374d-e2ea-45fe-93f1-f8ed56c42016 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1292 microversion: 2.1 time: 0.338522 May 12 17:45:21.465062 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 19/29] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:21 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1292 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:22.157237 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:22.158104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86a34b6e-f9f8-4980-89ac-9126d0d3aec5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:22.159111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:22.160379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-86a34b6e-f9f8-4980-89ac-9126d0d3aec5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:22.193622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.203146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.208838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.213156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.576155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86a34b6e-f9f8-4980-89ac-9126d0d3aec5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.589645 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86a34b6e-f9f8-4980-89ac-9126d0d3aec5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.596966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86a34b6e-f9f8-4980-89ac-9126d0d3aec5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.598540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-86a34b6e-f9f8-4980-89ac-9126d0d3aec5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1282 microversion: 2.20 time: 0.451992 May 12 17:45:22.600099 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 20/30] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:22 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1282 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:22.622911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:22.624045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:22.666032 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.677308 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.678673 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:22.680943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:22.908730 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:22.930211 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-84c7ee92-1d6f-4978-8a33-153a0a160404 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1280 microversion: 2.1 time: 0.322845 May 12 17:45:22.930961 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 21/31] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:22 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1280 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:23.417004 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:23.425738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0ace4cef-69d4-47d2-a5fa-c9c03fad30af tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 1.280794 May 12 17:45:23.426322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 11/32] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:22 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:23.626703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:23.627839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:23.668450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.681398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.684700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:23.685154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:23.950884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:23.951749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:24.005812 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.006408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.007177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.014956 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.083146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.106786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.109339 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.135174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-746221d7-84d6-437f-9508-e99c44c2f9a6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1334 microversion: 2.20 time: 0.516749 May 12 17:45:24.145029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 22/33] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:23 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1334 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:24.337664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:24.355577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-691cb2d2-e0cb-461c-88af-5ed4d5351137 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1280 microversion: 2.1 time: 0.410701 May 12 17:45:24.369880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 12/34] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:23 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1280 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:24.442884 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:24.443502 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:24.456508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.456991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:24.457749 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:24.462197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.164425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:25.165794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:25.174742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.175514 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.177115 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.178224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.416101 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.425093 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.432003 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.433204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-78156929-2560-4910-89dc-9921958376d5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1340 microversion: 2.20 time: 0.274047 May 12 17:45:25.436487 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 13/35] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:25 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1340 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:25.444866 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:25.445483 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:25.468034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.468528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.471346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:25.472795 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:25.577721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.601489 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ec65b5b6-8a46-4f65-8d57-2bab6cd26b16 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 1.162113 May 12 17:45:25.602022 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 23/36] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:24 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:25.645901 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:25.672523 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-af32e52f-d2be-471f-95c4-c6cbd8c6ee1e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1280 microversion: 2.1 time: 0.234629 May 12 17:45:25.674659 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 14/37] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:25 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:26.319914 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1820217567", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1221ba24-0e4c-4509-ac6d-bff82c57688b"}], "security_groups": [{"name": "tempest-securitygroup--1193092421"}], "key_name": "tempest-keypair-1702367950", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:26.455730 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:26.457559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:26.466455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.468313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.469394 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.470138 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.680187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] validate_networks() for [('1221ba24-0e4c-4509-ac6d-bff82c57688b', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:26.695809 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.757476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.765820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:26.767010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-88d79870-de1b-4174-b870-f7795fab2d3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1340 microversion: 2.20 time: 0.318058 May 12 17:45:26.767581 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 15/38] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:26 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1340 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:26.798002 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:26.817901 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:26.845843 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.846330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:26.847142 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:26.847588 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.418170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:27.428210 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-78b07043-70bd-4912-a70b-80d3b20d5f9d tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.658035 May 12 17:45:27.431339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 16/39] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:26 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:27.445030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:27.445998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:27.463968 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.467038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:27.476036 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:27.476676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.010234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.021622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cd35ed66-36a9-44c5-bbd2-ed22cca1c092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.587262 May 12 17:45:28.035149 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 17/40] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:27 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:28.042494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-83ff0907-e57c-445d-8126-9e972a67417a req-7afd4eaa-1c46-4a30-9553-7950a6c308dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a324263-603c-4a73-b819-232273b7c0bb", "tag": "aeff2539-2372-4118-8fd1-4b25292a34c4"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:28.061508 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-83ff0907-e57c-445d-8126-9e972a67417a req-7afd4eaa-1c46-4a30-9553-7950a6c308dd service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.062670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-83ff0907-e57c-445d-8126-9e972a67417a req-7afd4eaa-1c46-4a30-9553-7950a6c308dd service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.102972 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:28.103436 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:28.103861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:28.106776 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:28.107292 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:28.126513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.126973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.127784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.128270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.129000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-83ff0907-e57c-445d-8126-9e972a67417a req-7afd4eaa-1c46-4a30-9553-7950a6c308dd service nova] Creating event network-changed:aeff2539-2372-4118-8fd1-4b25292a34c4 for instance 8a324263-603c-4a73-b819-232273b7c0bb on hv-cinder-84052 May 12 17:45:28.129541 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-83ff0907-e57c-445d-8126-9e972a67417a req-7afd4eaa-1c46-4a30-9553-7950a6c308dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=123519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 17:45:28.130669 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.131111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.131894 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.139929 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.158561 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.compute.rpcapi [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 17:45:28.159736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] Releasing lock "compute-rpcapi-router" {{(pid=123519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 17:45:28.203257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:28.210462 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9948c0ab-426d-4731-ace0-6b63b9c3dc14 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173131 May 12 17:45:28.214552 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 18/41] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:28.218214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:28.237611 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.247117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.258821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:28.260949 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:28.278841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.283152 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.285255 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.288880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.382672 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-03e5a847-217b-433c-81e1-18c8882505a5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.066892 May 12 17:45:28.389434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 24/42] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:45:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:28.396421 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-30cb020f-5f1d-4842-8c90-bcf8e4075802 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.397429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-30cb020f-5f1d-4842-8c90-bcf8e4075802 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.608888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-30cb020f-5f1d-4842-8c90-bcf8e4075802 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:28.627607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-30cb020f-5f1d-4842-8c90-bcf8e4075802 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1242 microversion: 2.1 time: 0.236572 May 12 17:45:28.637398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 25/43] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1242 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:28.644210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:28.644841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:28.668454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.669179 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:28.672681 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:28.674172 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.140515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.148734 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.150244 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.151355 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-13bb6fa3-493f-4987-b3bc-71a70e5eefc5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.927636 May 12 17:45:29.151910 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 19/44] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:29.168844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:29.169508 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:29.182373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:29.182844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.183638 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:29.184086 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.424608 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.438053 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a30db35-79f8-4d7e-845e-9aa1127b1ee1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.799381 May 12 17:45:29.441358 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 26/45] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:28 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:29.625512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.637300 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-36f0301a-1e3a-4cf9-8c92-398b6789acd1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.476102 May 12 17:45:29.640050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 20/46] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:29 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:29.645528 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:29.646369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:29.654904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:29.655587 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.657280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:29.657926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:29.904952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:29.935310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c2b3f2c0-c3b4-4a26-9dcf-fa3ab4bdaf12 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1246 microversion: 2.1 time: 0.292734 May 12 17:45:29.940137 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 27/47] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:29 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1246 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:30.171411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:30.172041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:30.182809 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.183461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.184463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.188771 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.455693 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:30.462634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:30.484586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.485472 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.486770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.487435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.783589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.794564 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.797171 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.798526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e38638f6-4703-41e6-9d60-83c4c80adb36 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.631619 May 12 17:45:30.809057 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 21/48] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:30 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:30.809057 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-d81e3f2c-8b89-4681-b995-8526fa9f7047 req-f57c6e32-0b8c-4aa1-937a-3f4aa17a6830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f7a42c-b14d-4050-a589-70b0eb9ff31b", "tag": "08534155-023c-44b5-b553-dee4643d5c69"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:30.817125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d81e3f2c-8b89-4681-b995-8526fa9f7047 req-f57c6e32-0b8c-4aa1-937a-3f4aa17a6830 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.817573 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d81e3f2c-8b89-4681-b995-8526fa9f7047 req-f57c6e32-0b8c-4aa1-937a-3f4aa17a6830 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.840456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-d81e3f2c-8b89-4681-b995-8526fa9f7047 req-f57c6e32-0b8c-4aa1-937a-3f4aa17a6830 service nova] Creating event network-changed:08534155-023c-44b5-b553-dee4643d5c69 for instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b on hv-cinder-84052 May 12 17:45:30.848119 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-d81e3f2c-8b89-4681-b995-8526fa9f7047 req-f57c6e32-0b8c-4aa1-937a-3f4aa17a6830 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047256 May 12 17:45:30.848985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 22/49] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:30.858254 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:30.858954 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:30.865771 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.866914 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.867851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:30.868343 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:30.877271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:30.887180 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9a457121-6e01-4392-b08b-57462b282b46 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.434340 May 12 17:45:30.888036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 28/50] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:30 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:31.101577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.112892 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e94e0c62-815e-4ffc-b5fe-73f9fec025b9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.259388 May 12 17:45:31.113482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 23/51] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:30 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:31.129969 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:31.130588 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:31.144505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.146817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.148822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.157748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.234482 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-176c2780-52e9-494b-a319-06cc738172aa req-91968e23-4895-4b42-b0a1-c69ba3d0682c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:31.242458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-176c2780-52e9-494b-a319-06cc738172aa req-91968e23-4895-4b42-b0a1-c69ba3d0682c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.242855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-176c2780-52e9-494b-a319-06cc738172aa req-91968e23-4895-4b42-b0a1-c69ba3d0682c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.264721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.265282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-176c2780-52e9-494b-a319-06cc738172aa req-91968e23-4895-4b42-b0a1-c69ba3d0682c service nova] Creating event network-changed:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:45:31.270336 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-176c2780-52e9-494b-a319-06cc738172aa req-91968e23-4895-4b42-b0a1-c69ba3d0682c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.380377 May 12 17:45:31.270936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 29/52] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:31.276114 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-492aed79-672f-40df-8511-7c21c08e2b69 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1294 microversion: 2.1 time: 0.161627 May 12 17:45:31.276883 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 24/53] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:31 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:31.819284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:31.819969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:31.826601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.827222 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.827992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.828456 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.907617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:31.908499 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:31.929239 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.929694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.930486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:31.930925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:31.983737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.991995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.993686 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:31.994886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a7b3f3c-f1da-43d2-82cb-4887ff542b54 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.179747 May 12 17:45:31.995468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 30/54] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:31 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:32.070746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:32.079698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a75077c8-66da-42cd-87e6-e9b0fe63a852 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.177770 May 12 17:45:32.084247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 25/55] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:31 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:32.129843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:32.130452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:32.136155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.136632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.137386 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.137818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.269171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:32.276946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f16f27ba-03fd-4e40-b34d-2410988a4ee0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.150817 May 12 17:45:32.277530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 31/56] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:32 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:32.293813 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:32.294432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:32.300844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.301411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.302183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:32.302620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:32.370482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:32.380738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a30a947f-bb18-4a92-9445-8fc0775f7661 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1294 microversion: 2.1 time: 0.090542 May 12 17:45:32.381291 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 26/57] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:32 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:33.015362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:33.016350 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:33.024198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.026612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.033716 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.034194 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.097336 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:33.097861 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:33.104096 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.106318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.107953 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.109103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.350721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.366284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.370868 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.375355 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-337a5f47-02a7-4ec6-aaa3-11bba911e5da tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.362326 May 12 17:45:33.378606 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 32/58] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:33 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:33.388547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:33.391952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:33.407258 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.410391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.411408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.412286 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.474948 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.485460 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a92c63cc-561a-4cd8-a5f7-073021bed13e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.392600 May 12 17:45:33.496646 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 27/59] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:33 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:33.507441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:33.519940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:33.557896 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.561947 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.563306 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:33.565217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:33.678131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.688345 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2a646fdc-a964-478f-a720-9c55c25dd0b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.308169 May 12 17:45:33.699142 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 33/60] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:33 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:33.715720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:33.726202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4a01a8a0-8483-463a-97f7-f9babef12228 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1302 microversion: 2.1 time: 0.224515 May 12 17:45:33.727312 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 28/61] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:33 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1302 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:33.891836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-337112425", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "networks": [{"uuid": "93b2660a-d344-4f06-b874-791504190d8d"}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:33.948015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] validate_networks() for [('93b2660a-d344-4f06-b874-791504190d8d', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:45:34.304598 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:45:34.305185 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:45:34.305473 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:45:34.305879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:45:34.306280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:45:34.316438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.316890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.317681 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.318109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.336127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Getting quotas for project 887261f594284422bcd448d443d27013. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:45:34.339895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Getting quotas for user 9ad11a30da01449f82c1b94c7181860f and project 887261f594284422bcd448d443d27013. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:45:34.353073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:45:34.355696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:45:34.398305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.399223 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.405910 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.406702 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.407643 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.408151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.414288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-08b6eedd-70cf-4ddf-8b06-ffa1ba2177c8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527784 May 12 17:45:34.415001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 34/62] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:45:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:45:34.426409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f81d1209-1f93-4946-b411-be5524b64b77 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.427049 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f81d1209-1f93-4946-b411-be5524b64b77 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.490966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f81d1209-1f93-4946-b411-be5524b64b77 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.509639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f81d1209-1f93-4946-b411-be5524b64b77 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1213 microversion: 2.1 time: 0.087342 May 12 17:45:34.511019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 35/63] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:34.517111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.517384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.525779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.526300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.527280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.527853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.624339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.634409 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.636375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.637449 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f95805a3-a63f-487f-bd94-07a143bfa9c6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.244152 May 12 17:45:34.638630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 29/64] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:34.705125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.706001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.712577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.713358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.714376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.715086 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.720673 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.730415 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-51a9bd1c-48ec-459f-8747-4c242562b430 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.219164 May 12 17:45:34.731235 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 36/65] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:34.750748 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:34.751652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:34.757652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.758131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.758999 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:34.760010 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:34.859523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:34.870523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-967596f0-b652-4334-945d-3e579b976422 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1302 microversion: 2.1 time: 0.125510 May 12 17:45:34.871114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 37/66] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:35.092576 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.099800 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-82873b0f-fe36-4d2e-a8ab-521829ef36bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.398417 May 12 17:45:35.100391 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 30/67] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:34 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:35.526726 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.527337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.533862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.534318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.535080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.535516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.593114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.600257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b1aa43bd-79eb-41e9-887f-ae2e9294bb7f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1217 microversion: 2.1 time: 0.077330 May 12 17:45:35.600855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 38/68] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:35 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:35.657322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.657928 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.663774 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.664249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.665007 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.665455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.748928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.749547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.755461 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.755914 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.756714 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.757151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.791880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.800566 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.802220 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.803330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1823fc2f-3aad-47b3-80ef-4267f3a899d4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.151124 May 12 17:45:35.803899 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 31/69] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:35 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:35.889275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:35.889534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.890082 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:35.897163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.897614 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.897904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fd277b9b-a156-4ba1-8728-61e6af22f9a7 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.153166 May 12 17:45:35.898394 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:35.898577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 39/70] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:35 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:35.898834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:35.960705 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:35.967982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a8a9bf38-11cb-4d26-9ec4-f63c0c179e86 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1302 microversion: 2.1 time: 0.084248 May 12 17:45:35.968568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 32/71] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:35 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:36.116152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:36.116772 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:36.123253 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.123910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.124696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.125131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.249946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.257018 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5caa0272-e8d8-468b-915a-2df9c7f7eebb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.144675 May 12 17:45:36.257589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 40/72] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:36 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:36.619566 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:36.620046 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:36.629419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.631002 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.632016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.632830 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.696623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:36.704723 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c156b630-aa7f-408e-ba14-1f019deef914 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1265 microversion: 2.1 time: 0.091242 May 12 17:45:36.705381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 33/73] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:36 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:36.821195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:36.821724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:36.827680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.828134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.828934 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.829370 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.915780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:36.916433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:36.923681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.924424 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.925386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:36.925976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:36.994720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.005216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.006977 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.008418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a2a011e9-1235-4e41-9910-aa76391eacb5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.191269 May 12 17:45:37.009239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 41/74] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:36 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:37.014912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:37.016009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:37.022787 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.023331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.024200 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.024713 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.105191 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.122404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c598eb1f-6140-4f2a-ab68-92d8a779b6d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1300 microversion: 2.1 time: 0.111756 May 12 17:45:37.135388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 42/75] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:37 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:37.137969 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.146023 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a4b4245f-80d8-4767-bf5e-bfe39685343a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.233958 May 12 17:45:37.146595 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 34/76] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:36 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:37.273616 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:37.274265 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:37.279990 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.280534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.281375 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.281807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.438957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.446296 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-12dc0d82-2a8e-4e77-a09d-0ce7c09eb530 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.176511 May 12 17:45:37.446871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 43/77] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:37 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:37.721859 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:37.722519 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:37.728347 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.728796 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.729561 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:37.729998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:37.791940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:37.799944 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-21aa583e-ed3a-4b6b-b37f-a23a2d370d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1265 microversion: 2.1 time: 0.082169 May 12 17:45:37.800607 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 35/78] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:37 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:38.027031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.027803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.034803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.035257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.036035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.036512 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.142461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.143073 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.148827 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.149275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.150039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.150470 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.168306 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:38.177760 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:38.179617 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:38.180763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3f04b966-1f33-4022-9257-5b66e1133994 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.158123 May 12 17:45:38.181368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 44/79] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:38.186783 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.187389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.193272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.193717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.194663 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.195098 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.217100 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:38.224409 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c266c1e1-d5dc-4d86-b980-6a4544bc376f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1300 microversion: 2.1 time: 0.085825 May 12 17:45:38.224987 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 36/80] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:38.324028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:38.333969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-70a6f687-53e8-4bf4-b73c-a7b1f30dc601 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.151542 May 12 17:45:38.334568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 45/81] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:38.464691 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.465303 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.471799 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.472927 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.473903 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.474399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.824969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:38.825533 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:38.835597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.836054 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:38.836870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:38.839110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.068788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.078807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7c78ddba-fc82-45a8-9f91-2b3f4b2c1eea tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1265 microversion: 2.1 time: 0.263044 May 12 17:45:39.079497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 46/82] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:39.087138 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.099677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-496f9911-fcb1-4d48-8f9b-a781f155fc99 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.640425 May 12 17:45:39.103202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 37/83] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:38 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:39.203352 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:39.204532 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:39.223709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.224185 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.225010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.225680 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.327488 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-1807b982-ba25-4824-9f62-933a22e1e116 req-2058ab69-49d5-4aba-b17b-e631a7405942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a324263-603c-4a73-b819-232273b7c0bb", "name": "network-vif-plugged", "status": "completed", "tag": "aeff2539-2372-4118-8fd1-4b25292a34c4"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:39.338865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-1807b982-ba25-4824-9f62-933a22e1e116 req-2058ab69-49d5-4aba-b17b-e631a7405942 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.340591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-1807b982-ba25-4824-9f62-933a22e1e116 req-2058ab69-49d5-4aba-b17b-e631a7405942 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.362363 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-1807b982-ba25-4824-9f62-933a22e1e116 req-2058ab69-49d5-4aba-b17b-e631a7405942 service nova] Creating event network-vif-plugged:aeff2539-2372-4118-8fd1-4b25292a34c4 for instance 8a324263-603c-4a73-b819-232273b7c0bb on hv-cinder-84052 May 12 17:45:39.373081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-1807b982-ba25-4824-9f62-933a22e1e116 req-2058ab69-49d5-4aba-b17b-e631a7405942 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208245 May 12 17:45:39.374461 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 47/84] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:39.384210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:39.385131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:39.396103 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.397878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.399313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.399976 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.492678 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.512367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7f177278-83ac-46b1-bca1-ba3cef94f2bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1300 microversion: 2.1 time: 0.135682 May 12 17:45:39.514712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 48/85] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:39 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:39.521777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:39.522691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:39.536692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.537315 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.538146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:39.538593 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:39.581154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.595406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.598149 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.601491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-12152a92-5147-4803-9b81-c6e3d1b185df tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.406327 May 12 17:45:39.605240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 38/86] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:39 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:39.925929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:39.936640 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1a9ecbfc-fd40-47cb-bbb8-d404667cf648 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.420293 May 12 17:45:39.937445 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 49/87] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:39 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:40.098883 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.100074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.106322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.107056 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.109290 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.109933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.118698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.119872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.133663 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.134685 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.140504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.141253 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.247334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.256436 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-98c43372-15ed-421b-9014-cc2fc79ed2f8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1271 microversion: 2.1 time: 0.162883 May 12 17:45:40.257727 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 39/88] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:40.356036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.366911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b5afb2d9-e00e-4efa-9a01-3941580d7c79 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.251825 May 12 17:45:40.368272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 50/89] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:40.533874 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.534730 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.552615 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.554684 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.557921 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.558484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.626127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.626743 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.658325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.658325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.658325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.658325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.907098 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:40.920288 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-68745274-b194-435b-bdfc-926114e9601a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.387337 May 12 17:45:40.931103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 40/90] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:40.961241 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:40.962146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:40.979224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:40.982307 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:40.994348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.002102 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.002672 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.004174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.016362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.017540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0689411a-ec97-4957-9ddd-16214bcb7581 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.396535 May 12 17:45:41.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 51/91] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:41.160135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.168974 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-51b95cd4-a554-40e2-b4b8-8a9bdb6e63ae tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.219394 May 12 17:45:41.170544 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 41/92] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:40 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:41.275464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:41.276718 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:41.283791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.284271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.285853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.286299 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.385069 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:41.385692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:41.392661 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.393580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.394790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.399643 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.438126 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.445710 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4a775d69-07ae-42eb-b10a-4ec0ea5f5d90 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.174118 May 12 17:45:41.456186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 52/93] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:41 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:41.462282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-28505dc5-b8c5-49db-81f7-ec45b2c9e934 req-9c2f85f0-82af-4e36-bd55-3c1d0f4e62b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee0ce63-2c3a-49c2-bb05-03cee02949ad", "name": "network-vif-plugged", "status": "completed", "tag": "cd1d9d90-b454-463a-9a54-8dd81303eda8"}, {"server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:41.476229 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-28505dc5-b8c5-49db-81f7-ec45b2c9e934 req-9c2f85f0-82af-4e36-bd55-3c1d0f4e62b9 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.476901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-28505dc5-b8c5-49db-81f7-ec45b2c9e934 req-9c2f85f0-82af-4e36-bd55-3c1d0f4e62b9 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.501076 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-28505dc5-b8c5-49db-81f7-ec45b2c9e934 req-9c2f85f0-82af-4e36-bd55-3c1d0f4e62b9 service nova] Creating event network-vif-plugged:cd1d9d90-b454-463a-9a54-8dd81303eda8 for instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad on hv-cinder-84052 May 12 17:45:41.501589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-28505dc5-b8c5-49db-81f7-ec45b2c9e934 req-9c2f85f0-82af-4e36-bd55-3c1d0f4e62b9 service nova] Creating event network-vif-plugged:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:45:41.508280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-28505dc5-b8c5-49db-81f7-ec45b2c9e934 req-9c2f85f0-82af-4e36-bd55-3c1d0f4e62b9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050588 May 12 17:45:41.509247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 53/94] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:41.580048 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:41.587795 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7c85fb91-55d3-41f4-9381-5422d19c054b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.206419 May 12 17:45:41.588804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 42/95] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:41 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:41.937572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:41.938285 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:41.944863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.945309 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:41.946071 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:41.946682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.037827 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.038837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.050250 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.050857 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.051784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.055940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.199644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:42.207784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a8ffb49d-8f33-439a-9434-00692acd22a9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.274615 May 12 17:45:42.220260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 54/96] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:41 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:42.232506 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.234329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.266218 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.266474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.268564 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.271703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.740363 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:42.750051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:42.751968 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:42.753621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-483f679e-2ee8-42b0-b9d8-4a5c24233d47 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.720734 May 12 17:45:42.754454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 43/97] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:45:42.771925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.772822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.781166 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.781860 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.782924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.783594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.827372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:42.836594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8b6cca34-598d-4a0e-aa9a-3ee2c2e7c868 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.615138 May 12 17:45:42.837827 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 55/98] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:42.844617 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:42.845490 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:42.873843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.874574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:42.875573 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:42.876225 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.124234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.131517 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7d9d3d9f-ab6a-4160-b9a4-feb94dea3fb2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.364235 May 12 17:45:43.132407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 44/99] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:43.137139 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-373ae6e7-2392-4382-aeba-3082cd49340b req-7414303e-fe76-406e-b057-c165a59da1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753176e3-5139-4347-acab-50792e28f32e", "tag": "01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:43.147782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-373ae6e7-2392-4382-aeba-3082cd49340b req-7414303e-fe76-406e-b057-c165a59da1a5 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.148407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-373ae6e7-2392-4382-aeba-3082cd49340b req-7414303e-fe76-406e-b057-c165a59da1a5 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.161316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-373ae6e7-2392-4382-aeba-3082cd49340b req-7414303e-fe76-406e-b057-c165a59da1a5 service nova] Creating event network-changed:01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c for instance 753176e3-5139-4347-acab-50792e28f32e on hv-cinder-84052 May 12 17:45:43.164492 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.167003 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-373ae6e7-2392-4382-aeba-3082cd49340b req-7414303e-fe76-406e-b057-c165a59da1a5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033153 May 12 17:45:43.168217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 45/100] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:43.172691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77e463b6-c145-49e0-b8dc-e4f57a9511e2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.333325 May 12 17:45:43.173722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 56/101] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:42 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:43.225980 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:43.226677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:43.232722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.233211 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.233977 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.234412 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.369426 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:43.377824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-00b4ae75-2900-4684-914b-107a98313cfa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.156589 May 12 17:45:43.378388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 46/102] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:43 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:43.528909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-617be205-5e5f-467a-8ae7-352fb3f850b5 req-9cf54799-310f-455d-91ae-27d3d6977e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f7a42c-b14d-4050-a589-70b0eb9ff31b", "name": "network-vif-plugged", "status": "completed", "tag": "08534155-023c-44b5-b553-dee4643d5c69"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:43.537759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-617be205-5e5f-467a-8ae7-352fb3f850b5 req-9cf54799-310f-455d-91ae-27d3d6977e7c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.537759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-617be205-5e5f-467a-8ae7-352fb3f850b5 req-9cf54799-310f-455d-91ae-27d3d6977e7c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.549300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-617be205-5e5f-467a-8ae7-352fb3f850b5 req-9cf54799-310f-455d-91ae-27d3d6977e7c service nova] Creating event network-vif-plugged:08534155-023c-44b5-b553-dee4643d5c69 for instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b on hv-cinder-84052 May 12 17:45:43.554325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-617be205-5e5f-467a-8ae7-352fb3f850b5 req-9cf54799-310f-455d-91ae-27d3d6977e7c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029245 May 12 17:45:43.554911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 57/103] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:43.774608 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:43.775242 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:43.784013 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.784505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.785279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.785712 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.854997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:43.855806 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:43.870356 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.870834 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:43.873319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:43.874462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.043136 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.053053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.055195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.056818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c0735bec-ce47-4ea2-99a2-67f5bf562490 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.288119 May 12 17:45:44.067967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 47/104] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:43 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:44.111413 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.118579 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ef9415e2-da8c-4bdb-b179-ab22928d81fb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.268006 May 12 17:45:44.119160 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 58/105] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:43 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:44.150169 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:44.150823 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:44.158170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.158636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.159420 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.159906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.193646 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:44.194629 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:44.201112 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.201705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.202657 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.203090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.375605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.383272 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6699e3dd-de5f-4659-a4af-e4abc69da307 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.236862 May 12 17:45:44.384594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 48/106] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:44 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:44.394254 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:44.395068 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:44.396031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.401867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.402404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.405168 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e6b92024-7d6c-402e-8c2d-82aee9dbc207 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.219140 May 12 17:45:44.405769 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 59/107] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:44 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:44.410172 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:44.410735 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:44.546061 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:44.553276 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ca140810-6369-40f6-9f98-c06a8309f3ed tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.163011 May 12 17:45:44.553959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 49/108] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:44 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:45.074594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.075212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.082019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.082475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.083247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.083688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.135218 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.135855 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.142443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.142884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.143645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.144078 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.252256 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.260304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.261807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.262912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-76bb26d7-5aa9-4057-8e0e-2abcc303a44c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.192148 May 12 17:45:45.264354 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 60/109] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:45.269458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-20f7ec7e-efe0-4ea4-b513-fb32b4f8e094 req-442b0e56-d587-41f5-a567-7b5b558fdb3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959c1a20-6a14-4d41-a7a4-f7eded2fc759", "tag": "696c3de0-2f65-443b-a6cb-798a7dddbb0b"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:45.277233 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-20f7ec7e-efe0-4ea4-b513-fb32b4f8e094 req-442b0e56-d587-41f5-a567-7b5b558fdb3b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.277691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-20f7ec7e-efe0-4ea4-b513-fb32b4f8e094 req-442b0e56-d587-41f5-a567-7b5b558fdb3b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.290754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-20f7ec7e-efe0-4ea4-b513-fb32b4f8e094 req-442b0e56-d587-41f5-a567-7b5b558fdb3b service nova] Creating event network-changed:696c3de0-2f65-443b-a6cb-798a7dddbb0b for instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 on hv-cinder-84052 May 12 17:45:45.297729 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.298454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-20f7ec7e-efe0-4ea4-b513-fb32b4f8e094 req-442b0e56-d587-41f5-a567-7b5b558fdb3b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032701 May 12 17:45:45.299065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 61/110] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:45.305553 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6bd5e696-b0ec-4e05-904b-5dbc3fc61d20 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.174288 May 12 17:45:45.306111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 50/111] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:45.402133 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.402448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.409263 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.409684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.410449 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.410884 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.422052 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.422682 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.428725 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.429248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.430054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.430494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.596070 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.603165 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77efbcfd-fba0-46f6-8318-0667a2b4e878 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.205485 May 12 17:45:45.603938 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 62/112] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:45.608973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:45.609574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:45.610595 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.615838 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.616341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.617111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:45.617540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:45.619068 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-20689297-9723-4912-a6e9-8ec749b06f68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.201234 May 12 17:45:45.619453 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 51/113] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:45.743240 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:45.750691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f7cc9228-3333-4bcd-a685-83f7f7cfb581 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.146002 May 12 17:45:45.751261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 63/114] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:45 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:46.281585 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.282159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.287937 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.288422 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.289181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.289610 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.322605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.323216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.330372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.330905 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.331917 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.332465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.473334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.481037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.482600 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.483698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4b3d35e0-d06a-4f9c-931e-0d7c9b6e8189 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.206186 May 12 17:45:46.484295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 52/115] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:46.499661 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.506877 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7d5ea706-105f-4308-a912-50c550770914 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.188048 May 12 17:45:46.507441 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 64/116] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:46.621643 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.622569 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.630148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.630598 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.631449 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.631889 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.636274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.636965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.643430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.643879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.644671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.645143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.828654 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.833192 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.835842 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b8251d3e-d172-47da-9e31-5836d88cbe2c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.219057 May 12 17:45:46.836452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 53/117] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:46.840764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e5b0dc42-1fbf-45aa-8399-7e1ce828d4cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.208423 May 12 17:45:46.840946 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:46.841619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:46.842675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 65/118] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:46.847469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.847918 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.848716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:46.849151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:46.976419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:46.984354 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7b5e265c-a0e8-42d2-ac75-94d11e1627ac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.146941 May 12 17:45:46.984918 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 54/119] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:46 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:47.502656 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:47.503359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:47.509452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.509823 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.510599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.511030 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.524932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:47.525629 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:47.532578 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.533114 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.533983 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.534486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.723786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:47.728157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:47.732770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:47.734557 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:47.735907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6fc8ea0b-1c29-4476-969f-8ce617c83fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1408 microversion: 2.20 time: 0.237487 May 12 17:45:47.737049 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4dc8d006-ce1e-4d7d-92d9-e5a1da56ea96 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1315 microversion: 2.1 time: 0.215948 May 12 17:45:47.747157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 66/121] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:47 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:47.747971 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 55/121] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:47 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:47.853607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:47.854324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:47.859663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:47.860497 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:47.860660 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.861084 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.861838 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.862274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.867289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.867732 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:47.868519 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:47.868947 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.060870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.064823 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.068095 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-416e571a-3476-4175-bbd4-e6ab7d9b27ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.218958 May 12 17:45:48.068705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 67/122] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:47 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:48.072433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-72f4516e-c9de-4dbe-9c59-75e68a63936e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.218343 May 12 17:45:48.073063 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 56/123] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:47 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:48.073244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:48.074069 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:48.080400 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:48.080847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.081608 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:48.082048 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.236592 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:48.265237 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-de42479b-0d08-4c14-bc10-a6d2e3e43139 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.195418 May 12 17:45:48.266176 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 68/124] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:48 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:48.754517 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:48.755115 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:48.755468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:48.755559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:48.760872 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:48.761195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:48.761322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.761651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.762088 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:48.762425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:48.762518 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:48.762869 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.023677 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.030874 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.031551 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.033090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.034259 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8cbc2e1c-ee94-4292-bbc5-218c86174ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1600 microversion: 2.20 time: 0.283661 May 12 17:45:49.034826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 69/125] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:45:48 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1600 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:45:49.045258 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f99790c4-6b33-4811-849b-08470b06b8e9 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1502 microversion: 2.1 time: 0.294559 May 12 17:45:49.045837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 57/126] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:48 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:49.052688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:49.053174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:49.059534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.060687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.061477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.061896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.086303 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:49.087053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:49.093427 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.094130 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.095094 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.095750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.231981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0b96443a-d17a-49fe-8a49-fd58969431b0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.183029 May 12 17:45:49.233496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 70/127] 10.222.0.73 () {60 vars in 1315 bytes} [Thu May 12 17:45:49 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:45:49.238385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:49.253553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:49.264143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.264875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.265853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.269347 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.274333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.283480 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-209f23c1-6575-4585-a0d0-6c2cbf5f8eb8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.201385 May 12 17:45:49.284322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 58/128] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:49 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:49.296565 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:49.298153 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:49.305031 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.305543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.306376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:49.306822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:49.479867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.489895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5a681cea-2342-4236-8eb0-6b7c581e941d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.254937 May 12 17:45:49.491247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 71/129] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:49 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:49.529347 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:49.537454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7f4c2fbc-f3b8-4d7f-b2f8-35beb0b6b40b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.251764 May 12 17:45:49.538007 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 59/130] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:49 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:50.301823 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:50.303362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:50.309335 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.309800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.311858 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.311858 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.456017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.458204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7b7070d-3e31-4739-ac82-dca93bd60d7c"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:50.459450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:50.463408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-205b46a2-ddc3-4083-b4ac-f7f356b1ac38 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.165860 May 12 17:45:50.464188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 72/131] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:50 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:50.474551 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.475008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.475862 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.476353 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.507777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:50.508409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:50.516568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.517391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.518623 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.519273 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.660687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.680800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-edbfe539-26f7-41a6-8d22-151d5cce6376 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1322 microversion: 2.1 time: 0.176575 May 12 17:45:50.681728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 73/132] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:50 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:50.687199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:50.687935 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:50.694110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.694687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.695700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.696275 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.837626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:50.845498 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-52510fe6-432a-4c68-9d5f-ae0d3ed9becc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.162560 May 12 17:45:50.846140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 74/133] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:50 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:50.850831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-b79a8138-2c07-4afb-a9d4-8faf7d4de53e req-efd879a6-f7f4-44af-a7e5-443bf12036ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:50.860076 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-b79a8138-2c07-4afb-a9d4-8faf7d4de53e req-efd879a6-f7f4-44af-a7e5-443bf12036ca service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:50.860550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-b79a8138-2c07-4afb-a9d4-8faf7d4de53e req-efd879a6-f7f4-44af-a7e5-443bf12036ca service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:50.871883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-b79a8138-2c07-4afb-a9d4-8faf7d4de53e req-efd879a6-f7f4-44af-a7e5-443bf12036ca service nova] Creating event network-changed:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:45:50.878104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-b79a8138-2c07-4afb-a9d4-8faf7d4de53e req-efd879a6-f7f4-44af-a7e5-443bf12036ca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 May 12 17:45:50.878696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 75/134] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:51.482321 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:51.483754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:51.489995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.490644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.491576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.492187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.678720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:51.698831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-88aa3917-5040-4ba0-afde-47f7fba5fe23 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.220917 May 12 17:45:51.712500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 76/135] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:51 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:51.722658 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:51.723613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:51.733055 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.733837 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.736245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.737025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.907731 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:51.916510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-da1dfc4c-f3e8-4146-83d7-c37b072612a2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1516 microversion: 2.1 time: 0.202441 May 12 17:45:51.917588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 77/136] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:51 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:51.924316 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:51.925228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:51.932758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.933624 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:51.934899 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:51.936143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.114450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:52.122843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-509a7326-0ad6-4502-bc0f-4ff87995be94 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.203486 May 12 17:45:52.123427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 78/137] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:51 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:52.137649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:52.139713 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:52.145762 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.146213 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.146985 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.147417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.170811 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lazy-loading 'flavor' on Instance uuid e7f7a42c-b14d-4050-a589-70b0eb9ff31b {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:45:52.331393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-44ab796c-ab7f-41de-b16f-21bb80aafd08 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b/action" status: 200 len: 32 microversion: 2.1 time: 0.197565 May 12 17:45:52.332020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 79/138] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:45:52 2022] POST /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:45:52.342580 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:52.343268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:52.350887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.351414 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.352321 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.352781 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.511836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:52.524983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c9a5cf93-0ef7-45bf-a626-f5485d1eef42 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.187404 May 12 17:45:52.526205 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 80/139] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:52 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:52.717754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:52.718378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:52.728818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.729438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:52.734412 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:52.735100 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:53.016866 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-da487735-4b04-4bc2-8957-dae6f539b633 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "POST /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.562369 May 12 17:45:53.018747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 60/140] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:45:50 2022] POST /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad/os-volume_attachments => generated 194 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:53.142754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:53.144072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:53.175616 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:53.181502 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:53.217488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:53.221550 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:53.421142 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:53.432689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-051f9781-3fd5-44a2-ab2f-b765cc13b580 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.719216 May 12 17:45:53.433416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 81/141] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:52 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:53.542915 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:53.545059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:53.552557 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:53.553015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:53.553805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:53.554245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:53.597067 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:53.605176 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-56c18d1b-959d-4e50-a971-3e40af8325dc tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.467772 May 12 17:45:53.605759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 61/142] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:53 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:54.117934 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.130053 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2ff223d5-5cf6-4736-9809-3c8fb650336d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.591424 May 12 17:45:54.130626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 82/143] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:53 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:54.453600 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:54.455160 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:54.463766 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.464540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.465730 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.466459 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.624910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:54.626062 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:54.635591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.642398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.644235 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.645378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.660696 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:54.671987 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d5e068a2-e2d1-4c86-99eb-62505d9acc5b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.225601 May 12 17:45:54.679111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 62/144] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:54 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:54.917373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-6a72355f-8ba8-4f98-a0c4-0b1373ee65ea req-e6abd884-f1e3-43ae-ba5b-cb512dc29fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959c1a20-6a14-4d41-a7a4-f7eded2fc759", "name": "network-vif-plugged", "status": "completed", "tag": "696c3de0-2f65-443b-a6cb-798a7dddbb0b"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:54.937887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6a72355f-8ba8-4f98-a0c4-0b1373ee65ea req-e6abd884-f1e3-43ae-ba5b-cb512dc29fd3 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:54.938339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6a72355f-8ba8-4f98-a0c4-0b1373ee65ea req-e6abd884-f1e3-43ae-ba5b-cb512dc29fd3 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:54.956029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-6a72355f-8ba8-4f98-a0c4-0b1373ee65ea req-e6abd884-f1e3-43ae-ba5b-cb512dc29fd3 service nova] Creating event network-vif-plugged:696c3de0-2f65-443b-a6cb-798a7dddbb0b for instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 on hv-cinder-84052 May 12 17:45:54.974755 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-6a72355f-8ba8-4f98-a0c4-0b1373ee65ea req-e6abd884-f1e3-43ae-ba5b-cb512dc29fd3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073954 May 12 17:45:54.977553 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 63/145] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:45:55.037210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.053696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-55586645-872d-4eb3-8d50-ca0846e4ae5c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.434178 May 12 17:45:55.057711 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 83/146] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:54 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:55.148322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:55.150240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:55.159624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.161099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.161099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.161509 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.384610 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.393488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4fc3c764-2d66-4902-ae3e-21ccd48a1f13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.249799 May 12 17:45:55.394280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 64/147] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:55 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:55.695106 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:55.695757 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:55.702934 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.703392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.704148 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:55.706178 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:55.874561 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:55.882730 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5de45587-7f58-4a16-b45b-c6450a7d59be tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.191380 May 12 17:45:55.883338 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 84/148] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:55 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:56.074821 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:56.076075 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:56.084090 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.084770 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.085634 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.086173 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.229034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:56.241326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0a449bf7-8907-4cab-8fbb-b9e558d440f7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.166444 May 12 17:45:56.246616 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 65/149] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:56 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:56.411009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:56.411622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:56.417609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.418378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.420193 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.420898 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.612780 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:56.620899 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-55f53559-6b18-412a-97e6-b2d003c29fe4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.212304 May 12 17:45:56.620899 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 85/150] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:56 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:56.903086 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:56.904906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:56.912374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.913094 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:56.914177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:56.914790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.006269 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-1cf1a097-9f5d-40e2-954d-87952f180416 req-d4af6c0e-2509-432b-a240-cb0fb2db976a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753176e3-5139-4347-acab-50792e28f32e", "name": "network-vif-plugged", "status": "completed", "tag": "01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:45:57.018701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-1cf1a097-9f5d-40e2-954d-87952f180416 req-d4af6c0e-2509-432b-a240-cb0fb2db976a service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.019151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-1cf1a097-9f5d-40e2-954d-87952f180416 req-d4af6c0e-2509-432b-a240-cb0fb2db976a service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.034651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-1cf1a097-9f5d-40e2-954d-87952f180416 req-d4af6c0e-2509-432b-a240-cb0fb2db976a service nova] Creating event network-vif-plugged:01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c for instance 753176e3-5139-4347-acab-50792e28f32e on hv-cinder-84052 May 12 17:45:57.040484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-1cf1a097-9f5d-40e2-954d-87952f180416 req-d4af6c0e-2509-432b-a240-cb0fb2db976a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038095 May 12 17:45:57.046070 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 86/151] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:45:57.100171 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.120959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e362ab85-4251-4650-9638-66ba47edee81 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.224091 May 12 17:45:57.121721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 66/152] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:56 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:57.256925 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:57.257705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:57.290522 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.293192 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.294717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.295623 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.518954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.525909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-858cce5a-965f-4ab3-8ff2-6ba3ea1e4c77 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1368 microversion: 2.1 time: 0.273232 May 12 17:45:57.527064 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 87/153] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:57 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:57.636938 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:57.637557 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:57.646651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.647357 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.650647 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:57.651099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:57.815612 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:57.824590 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e8d9ec13-ec9e-47cd-ae70-18b7c81d177b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.192174 May 12 17:45:57.825169 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 67/154] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:57 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:58.139737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:58.140449 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:58.147231 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.147690 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.148484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.148922 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.366734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.375091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d9d7bb6f-1afd-4ef9-889b-28c03cec3bed tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.240458 May 12 17:45:58.384736 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 88/155] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:58 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:58.543499 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:58.546240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:58.553516 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.553959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.555178 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.556319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.716547 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:58.727132 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c1a0a0c2-fc87-4017-abff-23838812f45f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1557 microversion: 2.1 time: 0.188227 May 12 17:45:58.727934 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 68/156] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:58 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:45:58.746676 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:58.747836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:58.755689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.756690 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.757666 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.758453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.843069 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:58.843905 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:58.852459 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.854823 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.858589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:58.859252 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:58.871618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3615de42-080e-49fc-8e29-88e4b125ef39 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128694 May 12 17:45:58.872676 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 89/157] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:45:58 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:45:59.282022 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:59.291473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4af67e81-b7bb-4995-9c2b-a72cf0880803 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.453535 May 12 17:45:59.292062 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 69/158] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:58 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:45:59.393920 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:45:59.395298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:45:59.404041 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.404917 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.405928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:45:59.406520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:45:59.945724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:45:59.954293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6eedbcf3-1b5e-4df0-b883-a8089172825f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1313 microversion: 2.1 time: 0.565262 May 12 17:45:59.955596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 90/159] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:45:59 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:00.309309 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:00.310548 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:00.317123 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.317660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.318473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.318906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.566640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:00.574407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-be75c1c7-db8b-46fd-8454-3502f1658bdf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.269447 May 12 17:46:00.585781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 70/160] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:00 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:00.791597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-3745da09-58f5-426c-b0c0-0861c95ab644 req-6c4a316e-8400-4507-94e8-aec63776f29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959c1a20-6a14-4d41-a7a4-f7eded2fc759", "tag": "696c3de0-2f65-443b-a6cb-798a7dddbb0b"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:00.803635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3745da09-58f5-426c-b0c0-0861c95ab644 req-6c4a316e-8400-4507-94e8-aec63776f29a service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.805009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-3745da09-58f5-426c-b0c0-0861c95ab644 req-6c4a316e-8400-4507-94e8-aec63776f29a service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.820457 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-3745da09-58f5-426c-b0c0-0861c95ab644 req-6c4a316e-8400-4507-94e8-aec63776f29a service nova] Creating event network-changed:696c3de0-2f65-443b-a6cb-798a7dddbb0b for instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 on hv-cinder-84052 May 12 17:46:00.827191 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-3745da09-58f5-426c-b0c0-0861c95ab644 req-6c4a316e-8400-4507-94e8-aec63776f29a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039364 May 12 17:46:00.828351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 91/161] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:00.971869 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:00.972819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:00.980555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.984438 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:00.986620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:00.987272 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.254864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:01.264735 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b1eca0e8-3dcd-4735-b856-0af3e787211a tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1498 microversion: 2.1 time: 0.296604 May 12 17:46:01.265449 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 71/162] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:00 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1498 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:01.593955 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:01.594679 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:01.602336 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.603087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.604318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:01.604946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:01.812302 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:01.824460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cea77682-61d5-4773-95d1-a939f92daa02 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.236134 May 12 17:46:01.825344 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 92/163] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:01 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:02.136117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:02.136721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:02.152459 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.160204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.177267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.180382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.242609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:02.375996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-46526abe-89f3-43c7-938c-8749cb49f2c1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "DELETE /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 204 len: 0 microversion: 2.1 time: 0.251792 May 12 17:46:02.377078 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 72/164] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:46:02 2022] DELETE /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:02.389134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:02.390725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:02.397991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.398599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.399437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.399856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.552832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:02.561184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5e4ec810-fcc1-479e-b757-e87da6c1ea66 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.179449 May 12 17:46:02.561758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 93/165] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:02 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:02.843689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:02.844552 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:02.853122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.853699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.854684 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:02.855399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:02.998686 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.006405 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-16d10a4c-09ec-4618-9f0d-03e7a5303290 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.168283 May 12 17:46:03.006982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 73/166] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:02 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:03.578378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:03.578988 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:03.589284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.589722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.590537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:03.591496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:03.720676 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:03.727832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-54a31206-14c2-4f9d-aef2-b2a4eea4c0b9 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.153648 May 12 17:46:03.728437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 94/167] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:03 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:04.023401 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:04.024020 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:04.030625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.031076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.031841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.032304 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.157820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.165308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bb7a6396-e773-47ac-b784-f600321287b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.145768 May 12 17:46:04.165889 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 74/168] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:04 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:04.744825 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:04.745435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:04.752078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.752562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.753329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:04.753764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:04.897095 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:04.905303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3c8fb0c5-1002-4717-9d64-1267086b8d2e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.164205 May 12 17:46:04.905891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 95/169] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:04 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:05.182318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.182943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.190014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.190468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.191245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.191690 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.320366 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:05.328009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b154ff63-5450-44d9-aa07-2df378e1906b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.149523 May 12 17:46:05.328604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 75/170] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:05 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:05.519408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.519908 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.525738 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.526195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.526968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.527411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.551948 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:05.637438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d680a6ff-171b-4d9a-9c8c-1347cbaa5811 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 204 len: 0 microversion: 2.1 time: 0.121534 May 12 17:46:05.638585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 96/171] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:46:05 2022] DELETE /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:05.647006 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.647620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.654057 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.654584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.655358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.655800 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.783636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:05.791219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fe51efa1-d82a-49e0-b9dc-c65cf2906fb1 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1554 microversion: 2.1 time: 0.147927 May 12 17:46:05.791786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 76/172] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:05 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:05.922865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:05.923598 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:05.929605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.931500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:05.932342 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:05.932785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.062611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.069936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fbc06288-ff2e-4a07-9094-c080b3aedf0b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.152077 May 12 17:46:06.070500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 97/173] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:05 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:06.345481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:06.346026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:06.352653 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:06.353108 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.353880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:06.354323 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.477867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.486279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2cf02e52-394e-4f14-9f0f-f4bf17c34bc9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.145348 May 12 17:46:06.486858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 77/174] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:06 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:06.808093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:06.808729 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:06.814545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:06.814996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.815763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:06.816229 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:06.941859 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:06.949707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0d950002-0eae-45f7-907f-f1072e5b294c tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1554 microversion: 2.1 time: 0.145398 May 12 17:46:06.950789 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 98/175] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:06 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:07.087715 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:07.088357 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:07.094541 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.094982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.095742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.096196 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.223280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:07.230432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f4d2f413-3f61-4b68-8d1b-2f783a0f7d2f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.146603 May 12 17:46:07.231006 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 78/176] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:07 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:07.503798 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:07.504372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:07.510423 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.510874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.511641 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.512073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.644407 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:07.651601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0c10ac30-d457-4ea7-869d-c7074d3f495a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.151721 May 12 17:46:07.652210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 99/177] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:07 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:07.967903 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:07.968789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:07.975880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.976377 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:07.977153 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:07.977594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.107726 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.117064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2a929411-5be1-4a61-b11b-cb77436f0b81 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1554 microversion: 2.1 time: 0.153707 May 12 17:46:08.117792 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 79/178] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:07 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:08.247140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:08.248080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:08.254289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.254922 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.255882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.256365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.381008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.389168 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-28e1eb82-e5e3-4477-9a62-663977431ed2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.146087 May 12 17:46:08.389737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 100/179] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:08 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:08.668006 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:08.668689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:08.674808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.675294 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.676070 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:08.676671 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:08.803475 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:08.811216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4132c2d2-2bc3-4359-a570-6c12886b8bc8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.147000 May 12 17:46:08.811783 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 80/180] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:08 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:09.134353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:09.134970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:09.141304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.141750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.142519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.142953 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.271850 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:09.280064 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-963683d0-a5ee-4c3e-bca0-30a276c82cdc tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1554 microversion: 2.1 time: 0.149585 May 12 17:46:09.280661 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 101/181] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:09 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:09.405857 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:09.406458 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:09.412684 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.413124 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.413908 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.414335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.540828 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:09.548362 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-41188151-7b7a-4089-8ce9-b17d2933487f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.146256 May 12 17:46:09.548931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 81/182] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:09 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:09.827891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:09.828516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:09.834389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.834844 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.835617 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:09.836053 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:09.963036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:09.970403 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ed30f4c3-9ccb-4e84-b466-f1d68bd00bd0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.146479 May 12 17:46:09.970965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 102/183] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:09 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:10.296666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:10.297278 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:10.304529 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.304973 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.305734 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.306163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.429781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:10.437491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e1d9efeb-bd77-4399-8c24-3ebd671f389e tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1554 microversion: 2.1 time: 0.144677 May 12 17:46:10.438067 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 82/184] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:10 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:10.565620 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:10.566225 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:10.572190 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.572654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.573416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.573854 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.895057 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:10.902319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dcf89bb3-6ec0-46b0-a52f-a07bcdcbbc8f tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1504 microversion: 2.1 time: 0.340592 May 12 17:46:10.902893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 103/185] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:10 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:10.987260 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:10.987903 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:10.993740 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.994197 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:10.994960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:10.995418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.123489 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:11.131126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-90a67eba-c2e2-42e8-9029-4acee5cbb63a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.147717 May 12 17:46:11.131692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 83/186] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:10 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:11.315518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-484dd722-7f4c-4ee2-8855-ee8f325953ec req-00c01e2f-66f8-4884-a598-b86f861e9380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753176e3-5139-4347-acab-50792e28f32e", "name": "network-vif-unplugged", "status": "completed", "tag": "01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:11.326589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-484dd722-7f4c-4ee2-8855-ee8f325953ec req-00c01e2f-66f8-4884-a598-b86f861e9380 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.329907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-484dd722-7f4c-4ee2-8855-ee8f325953ec req-00c01e2f-66f8-4884-a598-b86f861e9380 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.455182 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:11.455804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:11.481026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.482034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.494067 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.494585 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.530125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-484dd722-7f4c-4ee2-8855-ee8f325953ec req-00c01e2f-66f8-4884-a598-b86f861e9380 service nova] Creating event network-vif-unplugged:01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c for instance 753176e3-5139-4347-acab-50792e28f32e on hv-cinder-84052 May 12 17:46:11.535725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-484dd722-7f4c-4ee2-8855-ee8f325953ec req-00c01e2f-66f8-4884-a598-b86f861e9380 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.228505 May 12 17:46:11.536987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 104/187] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:11.658507 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:11.666685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-be96b1a1-e4d6-4bb8-931f-8c67bc82d79a tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1554 microversion: 2.1 time: 0.216210 May 12 17:46:11.667257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 84/188] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:11 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:11.921098 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:11.921881 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:11.928499 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.928952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.929728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:11.930155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:11.999396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:12.007318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-707b6a65-a1ad-4606-9321-a9e8fd0e8d34 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 200 len: 1462 microversion: 2.1 time: 0.090761 May 12 17:46:12.007934 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 105/189] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:11 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:12.112372 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-39b6e21e-8ea7-4d07-b5c4-48b2442a6272 req-1cfb2339-62b8-4f13-a4e3-d857e1df8139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753176e3-5139-4347-acab-50792e28f32e", "name": "network-vif-deleted", "tag": "01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:12.121979 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-39b6e21e-8ea7-4d07-b5c4-48b2442a6272 req-1cfb2339-62b8-4f13-a4e3-d857e1df8139 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.122522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-39b6e21e-8ea7-4d07-b5c4-48b2442a6272 req-1cfb2339-62b8-4f13-a4e3-d857e1df8139 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.134018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-39b6e21e-8ea7-4d07-b5c4-48b2442a6272 req-1cfb2339-62b8-4f13-a4e3-d857e1df8139 service nova] Creating event network-vif-deleted:01981ad8-ac14-4cf7-bd6f-fd9ad27e6f3c for instance 753176e3-5139-4347-acab-50792e28f32e on hv-cinder-84052 May 12 17:46:12.139577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-39b6e21e-8ea7-4d07-b5c4-48b2442a6272 req-1cfb2339-62b8-4f13-a4e3-d857e1df8139 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 May 12 17:46:12.140209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 85/190] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:12.149020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:12.149759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:12.156601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.157135 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.157986 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.158560 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.417459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:12.420276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-39adce41-bdaf-400d-9906-2334ea5fdd8f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.275243 May 12 17:46:12.421461 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 106/191] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:12 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:12.689413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:12.691818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:12.700035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.701231 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.702566 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.705573 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.749225 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-c69acebf-db48-4985-a0f8-883ded4f5cd5 req-dbdda549-95ea-435c-bcce-aea01fdb927b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee0ce63-2c3a-49c2-bb05-03cee02949ad", "name": "network-vif-deleted", "tag": "cd1d9d90-b454-463a-9a54-8dd81303eda8"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:12.759835 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-c69acebf-db48-4985-a0f8-883ded4f5cd5 req-dbdda549-95ea-435c-bcce-aea01fdb927b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:12.760675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-c69acebf-db48-4985-a0f8-883ded4f5cd5 req-dbdda549-95ea-435c-bcce-aea01fdb927b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:12.773877 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-c69acebf-db48-4985-a0f8-883ded4f5cd5 req-dbdda549-95ea-435c-bcce-aea01fdb927b service nova] Creating event network-vif-deleted:cd1d9d90-b454-463a-9a54-8dd81303eda8 for instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad on hv-cinder-84052 May 12 17:46:12.780984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-c69acebf-db48-4985-a0f8-883ded4f5cd5 req-dbdda549-95ea-435c-bcce-aea01fdb927b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036565 May 12 17:46:12.784188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 107/192] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:12.807791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:12.820658 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-15fc81f2-2487-4b3b-8ee1-3bb3526fd6bf tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1512 microversion: 2.1 time: 0.138689 May 12 17:46:12.821468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 86/193] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:12 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:13.027007 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:13.027645 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: 753176e3-5139-4347-acab-50792e28f32e] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:13.033570 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.034006 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.034760 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.035190 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.047893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] HTTP exception thrown: Instance 753176e3-5139-4347-acab-50792e28f32e could not be found. May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Request method failure captured: May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e HTTP/1.1 May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUe77v4IFA55JTzZdybmxUlmffhxXRhy1oiI1GZ46CB2SnRh5Uu-VHD7f4T11ztHDJewGG6KRKJeWl0Tw8tbLZJ92NGnR8tVuWHMKBQ7Os2YU4up84rKyYV-cH_lAB3cjOkshtrY6bQ8gwPSTXNPP5IAeh5xWSpLxgJTTECdjGq9MCI May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 887261f594284422bcd448d443d27013 May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesActionsTest-1696156669 May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:46:13.052368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/887261f594284422bcd448d443d27013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/887261f594284422bcd448d443d27013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/887261f594284422bcd448d443d27013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_887261f594284422bcd448d443d27013", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesActionsTest-1696156669 May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 887261f594284422bcd448d443d27013 May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesActionsTest-1696156669 May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesActionsTest-1696156669-project May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 9ad11a30da01449f82c1b94c7181860f May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesActionsTest-1696156669-project May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 753176e3-5139-4347-acab-50792e28f32e could not be found. May 12 17:46:13.053804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '753176e3-5139-4347-acab-50792e28f32e'} May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753176e3-5139-4347-acab-50792e28f32e could not be found. May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:13.054613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753176e3-5139-4347-acab-50792e28f32e could not be found. May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753176e3-5139-4347-acab-50792e28f32e could not be found. May 12 17:46:13.055901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:13.057080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Returning 404 to user: Instance 753176e3-5139-4347-acab-50792e28f32e could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:13.057080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5f2efde0-4f8d-4c10-a745-43e328c4ba91 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e" status: 404 len: 111 microversion: 2.1 time: 0.031033 May 12 17:46:13.057080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 108/194] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:13 2022] GET /compute/v2.1/servers/753176e3-5139-4347-acab-50792e28f32e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:13.179474 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1854960304", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "networks": [{"uuid": "93b2660a-d344-4f06-b874-791504190d8d"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:13.237486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] validate_networks() for [('93b2660a-d344-4f06-b874-791504190d8d', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:46:13.438340 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:13.438966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:13.445571 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.446014 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.446821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.447303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.663637 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:13.671910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0106e0e1-e5e5-4b48-9d13-118b6d789630 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.238311 May 12 17:46:13.682462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 109/195] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:13 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:13.689365 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:46:13.689971 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:46:13.690584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:46:13.690842 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:46:13.691253 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:46:13.703413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.704281 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.705163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.705609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.723395 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Getting quotas for project 887261f594284422bcd448d443d27013. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:13.727955 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Getting quotas for user 9ad11a30da01449f82c1b94c7181860f and project 887261f594284422bcd448d443d27013. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:13.740088 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:46:13.742531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:46:13.801160 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6fa21f9f-701e-4e7e-a14d-52b7d03055ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625751 May 12 17:46:13.807409 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 87/196] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:46:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:46:13.813345 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-97dc9b82-8374-4142-9f02-cbb0aade4c3b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:13.814023 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-97dc9b82-8374-4142-9f02-cbb0aade4c3b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:13.855058 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:13.858433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:13.872625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.873148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.874203 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.874671 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.875689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-97dc9b82-8374-4142-9f02-cbb0aade4c3b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:13.885115 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-97dc9b82-8374-4142-9f02-cbb0aade4c3b tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1214 microversion: 2.1 time: 0.076722 May 12 17:46:13.886077 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 110/197] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:13 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:13.945264 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:13.945874 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:13.946377 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lazy-loading 'fault' on Instance uuid 1ee0ce63-2c3a-49c2-bb05-03cee02949ad {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:14.001474 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b00b6242e52a4ab1bc98280fe7242647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a12890be016462ea430af4ff0080553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:14.008447 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6a87e22b-7278-4a59-87dc-ee290ffc8f93 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 200 len: 1305 microversion: 2.1 time: 0.166091 May 12 17:46:14.009035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 88/198] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:13 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:14.689889 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:14.690420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:14.696954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.697552 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.698348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.698797 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.829556 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:14.838983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f6f6ae7f-19a7-4127-b40a-bd605f2d2707 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.152974 May 12 17:46:14.839840 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 111/199] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:14 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:14.903150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:14.905232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:14.914146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.914912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:14.915958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:14.916526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.015258 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:15.023447 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f9c05d21-2294-450b-9cd2-b4217c93578d tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1266 microversion: 2.1 time: 0.124475 May 12 17:46:15.024471 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 89/200] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:14 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:15.026745 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:15.027367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:15.038541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.039189 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.041141 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.041763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.062404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] HTTP exception thrown: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Request method failure captured: May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad HTTP/1.1 May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeXb4yIqutVHYTS9ttUABMm96MN5cq9s3u5yzs0DU-aJYgseVE6fhIm0M-rOEop2Ad-h962Cz6p11Uyb79j7rx_FMSOr7zG9Il_ih1NF_svg8vjoK3PfcfCb8mfB6lRYmfyPAJk8aY3hH1gnT62mV7h8evYDnY_ctYS0QiiOeVJujU May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:46:15.064301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a12890be016462ea430af4ff0080553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a12890be016462ea430af4ff0080553", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-DeleteServersTestJSON-574370651 May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: b00b6242e52a4ab1bc98280fe7242647 May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.065697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '1ee0ce63-2c3a-49c2-bb05-03cee02949ad'} May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:15.066562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.068251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:15.070510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Returning 404 to user: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:15.071554 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b86aed71-95ef-47c8-9b28-137ebf6ea936 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 404 len: 111 microversion: 2.1 time: 0.049214 May 12 17:46:15.076649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 112/201] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:15 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:15.204130 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:15.205501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:15.213553 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.214259 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.215224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.215965 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.245476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] HTTP exception thrown: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Request method failure captured: May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad/os-volume_attachments HTTP/1.1 May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeXb4yIqutVHYTS9ttUABMm96MN5cq9s3u5yzs0DU-aJYgseVE6fhIm0M-rOEop2Ad-h962Cz6p11Uyb79j7rx_FMSOr7zG9Il_ih1NF_svg8vjoK3PfcfCb8mfB6lRYmfyPAJk8aY3hH1gnT62mV7h8evYDnY_ctYS0QiiOeVJujU May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:46:15.258699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a12890be016462ea430af4ff0080553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a12890be016462ea430af4ff0080553", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-DeleteServersTestJSON-574370651 May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: b00b6242e52a4ab1bc98280fe7242647 May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.260492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'server_id': '1ee0ce63-2c3a-49c2-bb05-03cee02949ad'} May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:15.261216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:15.263121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:15.264233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Returning 404 to user: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:15.264233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec7a2304-6792-481d-9c9f-5fee92e05fde tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062478 May 12 17:46:15.264233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 90/202] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:46:15 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:15.857979 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:15.858605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:15.867235 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.867688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:15.868605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:15.869100 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.040752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:16.042123 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:16.049273 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.049718 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.050663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.051254 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.120447 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:16.127414 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-da1a7406-a179-4b46-96e4-0e4e5c2f7f77 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.274536 May 12 17:46:16.128195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 113/203] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:15 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:16.320642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:16.331642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f28cb5a8-73c2-47ff-9d10-81975dcca000 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.294448 May 12 17:46:16.341361 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 91/204] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:16 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:16.506422 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:16.506925 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:16.513892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.514894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.516187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.516794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.532940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] HTTP exception thrown: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Request method failure captured: May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad HTTP/1.1 May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeXb4yIqutVHYTS9ttUABMm96MN5cq9s3u5yzs0DU-aJYgseVE6fhIm0M-rOEop2Ad-h962Cz6p11Uyb79j7rx_FMSOr7zG9Il_ih1NF_svg8vjoK3PfcfCb8mfB6lRYmfyPAJk8aY3hH1gnT62mV7h8evYDnY_ctYS0QiiOeVJujU May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:46:16.534750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a12890be016462ea430af4ff0080553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a12890be016462ea430af4ff0080553", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-DeleteServersTestJSON-574370651 May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: b00b6242e52a4ab1bc98280fe7242647 May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.536020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '1ee0ce63-2c3a-49c2-bb05-03cee02949ad'} May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:16.536741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.538453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:16.540028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Returning 404 to user: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:16.540028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a221868f-5fb2-4e9d-ba0a-b9cbcf6a96eb tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 404 len: 111 microversion: 2.1 time: 0.035155 May 12 17:46:16.540028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 114/205] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:46:16 2022] DELETE /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:16.546035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:16.546656 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] [instance: 1ee0ce63-2c3a-49c2-bb05-03cee02949ad] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:16.553280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.553664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.554450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.554890 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.569641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] HTTP exception thrown: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Request method failure captured: May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad HTTP/1.1 May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeXb4yIqutVHYTS9ttUABMm96MN5cq9s3u5yzs0DU-aJYgseVE6fhIm0M-rOEop2Ad-h962Cz6p11Uyb79j7rx_FMSOr7zG9Il_ih1NF_svg8vjoK3PfcfCb8mfB6lRYmfyPAJk8aY3hH1gnT62mV7h8evYDnY_ctYS0QiiOeVJujU May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:46:16.572315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a12890be016462ea430af4ff0080553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a12890be016462ea430af4ff0080553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a12890be016462ea430af4ff0080553", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-DeleteServersTestJSON-574370651 May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 4a12890be016462ea430af4ff0080553 May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-DeleteServersTestJSON-574370651 May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: b00b6242e52a4ab1bc98280fe7242647 May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-DeleteServersTestJSON-574370651-project May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.574116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '1ee0ce63-2c3a-49c2-bb05-03cee02949ad'} May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:16.574895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. May 12 17:46:16.576559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:46:16.578458 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] Returning 404 to user: Instance 1ee0ce63-2c3a-49c2-bb05-03cee02949ad could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:16.579457 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b2e55bf4-064d-4bea-8752-d83dd7167585 tempest-DeleteServersTestJSON-574370651 tempest-DeleteServersTestJSON-574370651-project] 10.222.0.73 "GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad" status: 404 len: 111 microversion: 2.1 time: 0.038102 May 12 17:46:16.580214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 92/206] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:16 2022] GET /compute/v2.1/servers/1ee0ce63-2c3a-49c2-bb05-03cee02949ad => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:16.709388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-252cc4a5-8a58-4900-ac7b-6edeb79ad5b4 req-ac13c440-5891-4da3-a89c-329018c3b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82d9702-9dfa-42d6-9ffb-efa1acdf9834", "tag": "5f74c6d9-1993-4659-908e-aaaf1e7bab41"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:16.721389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-252cc4a5-8a58-4900-ac7b-6edeb79ad5b4 req-ac13c440-5891-4da3-a89c-329018c3b5fe service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:16.722175 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-252cc4a5-8a58-4900-ac7b-6edeb79ad5b4 req-ac13c440-5891-4da3-a89c-329018c3b5fe service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:16.743087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-252cc4a5-8a58-4900-ac7b-6edeb79ad5b4 req-ac13c440-5891-4da3-a89c-329018c3b5fe service nova] Creating event network-changed:5f74c6d9-1993-4659-908e-aaaf1e7bab41 for instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 on hv-cinder-84052 May 12 17:46:16.750044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-252cc4a5-8a58-4900-ac7b-6edeb79ad5b4 req-ac13c440-5891-4da3-a89c-329018c3b5fe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050889 May 12 17:46:16.751403 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 115/207] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:17.144235 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:17.144847 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:17.151089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.151536 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.152387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.152747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.349436 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:17.350152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:17.356491 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.357267 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.357753 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:17.358367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:17.454166 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:17.463343 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-439edc70-4dbf-4799-a91a-16186b749ab0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.322793 May 12 17:46:17.463919 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 93/208] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:17 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:17.545656 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:17.553171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1e8d0878-011d-477a-93a2-363327b69979 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.207869 May 12 17:46:17.554112 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 116/209] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:17 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:18.481580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:18.482831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:18.489467 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:18.489915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:18.490688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:18.491177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:18.577115 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:18.577815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:18.589646 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:18.590109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:18.590929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:18.592430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:18.656277 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:18.665654 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a55f7ade-d56f-4048-9304-c31d78a5327c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.188283 May 12 17:46:18.666318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 94/210] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:18 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:18.748789 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:18.757447 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d8765ad6-3e24-4df8-85d4-ec5e6435acd6 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.189301 May 12 17:46:18.758014 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 117/211] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:18 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:19.682621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:19.683320 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:19.690651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.691189 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.691980 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.692506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.774323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:19.774936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:19.781408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.781860 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.782630 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:19.783065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:19.837519 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:19.846047 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1a2de540-971e-4509-9ee2-777f16ddb0f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.167212 May 12 17:46:19.846632 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 95/212] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:19 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:19.963427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:19.971980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bdd00cda-258a-48ef-8f72-4df440d92e88 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.201444 May 12 17:46:19.972584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 118/213] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:19 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:20.862769 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:20.863329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:20.869216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:20.869667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:20.870432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:20.870866 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:20.990222 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:20.990848 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:20.998042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:20.998532 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:20.999577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:21.000009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:21.013789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:21.024807 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d3232b69-451b-46c3-b065-d2b26b89f87b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.165904 May 12 17:46:21.025394 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 96/214] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:20 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:21.143755 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:21.151001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9077efca-c810-40bc-a893-1478325674e0 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.164891 May 12 17:46:21.151575 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 119/215] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:20 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:22.041613 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:22.042221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:22.049084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:22.049538 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:22.050308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:22.050746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:22.173603 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:22.174506 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:22.181337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:22.181847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:22.182269 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:22.182778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:22.183390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:22.190509 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6bc9a8e9-afa1-403c-bae2-dc866fff51e6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.152751 May 12 17:46:22.191122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 97/216] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:22 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:22.322127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:22.329626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8740e663-7f4c-465f-bd73-4b054e9f6ca2 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.163986 May 12 17:46:22.330276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 120/217] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:22 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:23.173274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-47abf7db-a46b-4157-b859-4d0de8cf5c5f tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c63344c0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:23.207238 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:23.207876 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:23.213687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.214136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.214911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.215385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.226584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-47abf7db-a46b-4157-b859-4d0de8cf5c5f tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c0943452-58a6-4185-9e07-1974b5bdcd1b" status: 200 len: 350 microversion: 2.1 time: 0.057274 May 12 17:46:23.227494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 98/218] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:46:23 2022] GET /compute/v2.1/os-volumes/c0943452-58a6-4185-9e07-1974b5bdcd1b => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:23.348686 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:23.349981 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:23.361332 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.362341 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.363960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:23.364724 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:23.405045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:23.417192 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ec2edd19-f177-46ae-8ff7-559ac6d1c54e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.213659 May 12 17:46:23.417996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 121/219] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:23 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:23.565407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:23.573185 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c7a13d98-3997-464e-8bee-7ada36445f29 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.229582 May 12 17:46:23.587224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 99/220] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:23 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:24.435335 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:24.437236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:24.447007 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:24.447454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:24.448251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:24.448685 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:24.579457 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:24.587591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f2b7e92f-346f-44b8-8579-6b9a8eae7c2d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.156591 May 12 17:46:24.588204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 122/221] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:24 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:24.594740 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:24.595358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:24.608433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:24.608885 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:24.609656 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:24.610089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:24.615116 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5145361a-0661-4062-94b8-13ff814d04db tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c64c7280>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:24.666294 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5145361a-0661-4062-94b8-13ff814d04db tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/3ffaec8c-5203-4d4a-a08e-7db231dcd6ec" status: 200 len: 351 microversion: 2.1 time: 0.054868 May 12 17:46:24.666888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 123/222] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:46:24 2022] GET /compute/v2.1/os-volumes/3ffaec8c-5203-4d4a-a08e-7db231dcd6ec => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:24.773186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:24.782450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b2ff186c-6aca-4652-b64f-cb133803de3c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.192401 May 12 17:46:24.783578 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 100/223] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:24 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:25.604387 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:25.605005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:25.611846 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:25.612594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:25.613719 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:25.614387 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:25.755479 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:25.764892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3eb79680-2452-4096-adf5-eeedaf8ad0cb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.163663 May 12 17:46:25.765657 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 124/224] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:25 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:25.800959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:25.801580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:25.808537 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:25.809001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:25.810037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:25.810554 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:25.959922 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:25.967420 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4306a279-a3c0-4165-9380-002fba558062 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.171327 May 12 17:46:25.969019 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 101/225] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:25 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:26.017682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a270c072-988e-4ee8-bc97-e4b41804552f tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c64c7280>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.062823 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a270c072-988e-4ee8-bc97-e4b41804552f tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/6fa79552-af13-48e3-a72e-4c88e9ce5b11" status: 200 len: 351 microversion: 2.1 time: 0.049428 May 12 17:46:26.063428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 125/226] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes/6fa79552-af13-48e3-a72e-4c88e9ce5b11 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:26.074223 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-05870d33-f6ab-4508-bbe3-a8699e2c263d tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c633e8b0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.157434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-05870d33-f6ab-4508-bbe3-a8699e2c263d tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086879 May 12 17:46:26.157994 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 102/227] 10.222.0.73 () {58 vars in 1133 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:26.169901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a1b4aa16-97a1-44d5-acf8-d245dcac4491 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c5af45e0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.251965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a1b4aa16-97a1-44d5-acf8-d245dcac4491 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085803 May 12 17:46:26.252634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 126/228] 10.222.0.73 () {58 vars in 1148 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.265498 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec566b21-24c9-411a-80d7-31e5b85f135f tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c63345e0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.347642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec566b21-24c9-411a-80d7-31e5b85f135f tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087181 May 12 17:46:26.348229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 103/229] 10.222.0.73 () {58 vars in 1133 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:26.360686 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3d15a4a7-01b7-4d54-8b39-a21f75fd54bb tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c7de4e50>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.444876 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3d15a4a7-01b7-4d54-8b39-a21f75fd54bb tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089415 May 12 17:46:26.445454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 127/230] 10.222.0.73 () {58 vars in 1166 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.458888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-460aba47-a7c1-4897-9a87-5b56320fa858 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c62f6b80>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.539497 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-460aba47-a7c1-4897-9a87-5b56320fa858 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085084 May 12 17:46:26.540077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 104/231] 10.222.0.73 () {58 vars in 1169 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.552518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6a68e0a9-8ef0-4cb1-a1c4-17e1e1e47b09 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c5a7fe50>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.643501 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6a68e0a9-8ef0-4cb1-a1c4-17e1e1e47b09 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094674 May 12 17:46:26.644206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 128/232] 10.222.0.73 () {58 vars in 1154 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:26.657120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2fc91181-cd0c-4d07-bd6d-c9c1cba1d66c tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c62f6940>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.739263 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2fc91181-cd0c-4d07-bd6d-c9c1cba1d66c tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086762 May 12 17:46:26.739826 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 105/233] 10.222.0.73 () {58 vars in 1187 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.752270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8190b9cd-7f4c-4cae-aa57-4eddd8a03db9 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] Calling method '.version_select at 0x7fc0c64c7430>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.781811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.782429 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:26.799724 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.800204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.801273 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.801847 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.874957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8190b9cd-7f4c-4cae-aa57-4eddd8a03db9 tempest-VolumesTestJSON-1158436623 tempest-VolumesTestJSON-1158436623-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.126374 May 12 17:46:26.875980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 129/234] 10.222.0.73 () {58 vars in 1154 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:26.886959 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-f84b55a4-801e-445d-8671-211be029abb0 req-5caceacd-6c65-4bf5-b25d-ad90d7038d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d9702-9dfa-42d6-9ffb-efa1acdf9834", "name": "network-vif-plugged", "status": "completed", "tag": "5f74c6d9-1993-4659-908e-aaaf1e7bab41"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:26.909957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f84b55a4-801e-445d-8671-211be029abb0 req-5caceacd-6c65-4bf5-b25d-ad90d7038d3f service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.910601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f84b55a4-801e-445d-8671-211be029abb0 req-5caceacd-6c65-4bf5-b25d-ad90d7038d3f service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.929455 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-f84b55a4-801e-445d-8671-211be029abb0 req-5caceacd-6c65-4bf5-b25d-ad90d7038d3f service nova] Creating event network-vif-plugged:5f74c6d9-1993-4659-908e-aaaf1e7bab41 for instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 on hv-cinder-84052 May 12 17:46:26.941548 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-f84b55a4-801e-445d-8671-211be029abb0 req-5caceacd-6c65-4bf5-b25d-ad90d7038d3f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059899 May 12 17:46:26.942545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 130/235] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:26.986851 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:26.987521 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:26.995694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.996392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:26.997389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:26.997982 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:27.044073 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:27.052532 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-475a1730-515b-4b99-a585-7d848e74d8e7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.274906 May 12 17:46:27.064686 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 106/236] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:27.224309 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:27.231302 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-872ba2b8-488f-4c48-a40e-30dfcbdba0e7 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.249149 May 12 17:46:27.232591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 131/237] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:26 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:28.085743 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:28.087324 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:28.102907 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:28.105181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:28.107872 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:28.108995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:28.251511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:28.252145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:28.267028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:28.267849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:28.268759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:28.269434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:28.493838 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:28.496688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:28.504912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b75bf4a9-7788-4c04-a6b0-ee9715e02bbb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.438925 May 12 17:46:28.505473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 107/238] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:28 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:28.515574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-86aa7ef4-b0a6-4aea-aaa6-8e473d539433 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1314 microversion: 2.1 time: 0.267294 May 12 17:46:28.529822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 132/239] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:28 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:29.521548 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:29.522159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:29.528434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:29.528893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:29.529661 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:29.530934 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:29.537540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:29.538544 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:29.544632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:29.545200 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:29.547055 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:29.547317 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:29.757329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:29.762751 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:29.765869 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e062323c-67bc-457f-b6b9-13f215ce8aa0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.248099 May 12 17:46:29.766761 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 108/240] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:29 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:29.771253 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-47ec41a3-7691-49cc-aed6-a467800285ae tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1498 microversion: 2.1 time: 0.237533 May 12 17:46:29.771819 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 133/241] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:29 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:30.265455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1850512374", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:30.318235 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] validate_networks() for None {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:46:30.496895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:30.497820 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:30.504518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.504968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.505935 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.506538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.536875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:30.671995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-915d083c-4de2-447d-ada0-c4accc14c20e tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 204 len: 0 microversion: 2.1 time: 0.178403 May 12 17:46:30.674016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 134/242] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:46:30 2022] DELETE /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:30.696340 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:30.697210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:30.705140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.705821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.706836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.707637 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.735891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:46:30.736319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:46:30.736789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:46:30.737383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:46:30.737973 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:46:30.747592 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.748268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.750751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.751486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.787613 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Getting quotas for project e53ce05ac35c48aeb17842025bb4c455. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:30.794005 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Getting quotas for user 2e95c3d471634389a70bfcd7515085ae and project e53ce05ac35c48aeb17842025bb4c455. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:30.808985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:46:30.812877 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:46:30.863155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:30.871513 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2595d488-a153-41ed-a1a8-68cf3bc18262 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610463 May 12 17:46:30.872708 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2512a190-f950-46d3-b9ee-770d135fd10c tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1504 microversion: 2.1 time: 0.184560 May 12 17:46:30.874437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 135/243] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:30 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:30.883764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 109/244] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:46:30.890494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a5d77dab-ed0f-44c2-a9a1-16ba6a4d4148 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:30.891840 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:30.891957 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a5d77dab-ed0f-44c2-a9a1-16ba6a4d4148 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:30.893817 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:30.903701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.906434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.907407 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:30.907891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:30.989316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a5d77dab-ed0f-44c2-a9a1-16ba6a4d4148 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:31.002456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a5d77dab-ed0f-44c2-a9a1-16ba6a4d4148 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1215 microversion: 2.1 time: 0.116843 May 12 17:46:31.003387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 110/245] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:30 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:31.104216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:31.114375 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ae2b5bbe-03c5-4e3c-91a2-4af57317698d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.238327 May 12 17:46:31.114975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 136/246] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:30 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:31.890714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:31.892058 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:31.899721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:31.900547 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:31.901597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:31.902262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.019119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:32.019771 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:32.025833 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:32.026284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.027145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:32.027581 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.143787 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:32.151669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e92fd068-0c94-4370-bb3c-e0bba22d21da tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1219 microversion: 2.1 time: 0.136479 May 12 17:46:32.152276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 137/247] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:32 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:32.161478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:32.161478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:32.170429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:32.171520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.172585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:32.173022 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:32.200017 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:32.216530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1d895328-a9ce-46cc-b0b1-63497232ccc8 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1504 microversion: 2.1 time: 0.329847 May 12 17:46:32.217868 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 111/248] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:31 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:32.414763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:32.431426 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-56063f65-d700-4586-90f7-6fe0e25f6960 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.276605 May 12 17:46:32.446551 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 138/249] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:32 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:33.171537 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:33.172545 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:33.179549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.179995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.180806 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.181355 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.237015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:33.238069 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:33.246820 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.247832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.249669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.250261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.284922 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:33.296988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e167b67a-f133-4ef3-af86-31d9c6044592 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1267 microversion: 2.1 time: 0.130939 May 12 17:46:33.297670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 112/250] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:33 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:33.456632 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:33.456632 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:33.460684 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.461143 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.461936 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.462381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.533366 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:33.540955 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bf5d1c86-850e-4265-bb1a-2d2eb38ff621 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1504 microversion: 2.1 time: 0.309182 May 12 17:46:33.541556 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 139/251] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:33 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:33.684841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:33.695185 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-63494164-fcd9-43a2-a6a9-d4b459f6cdbf tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1522 microversion: 2.1 time: 0.246997 May 12 17:46:33.696187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 113/252] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:33 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:33.840213 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-9127ca56-c7b0-406b-8c41-2e5f4ac23678 req-d0da7fc8-7c1b-492b-a60f-a6304840b573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d9702-9dfa-42d6-9ffb-efa1acdf9834", "name": "network-vif-deleted", "tag": "5f74c6d9-1993-4659-908e-aaaf1e7bab41"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:33.848734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-9127ca56-c7b0-406b-8c41-2e5f4ac23678 req-d0da7fc8-7c1b-492b-a60f-a6304840b573 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:33.849186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-9127ca56-c7b0-406b-8c41-2e5f4ac23678 req-d0da7fc8-7c1b-492b-a60f-a6304840b573 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:33.860111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-9127ca56-c7b0-406b-8c41-2e5f4ac23678 req-d0da7fc8-7c1b-492b-a60f-a6304840b573 service nova] Creating event network-vif-deleted:5f74c6d9-1993-4659-908e-aaaf1e7bab41 for instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 on hv-cinder-84052 May 12 17:46:33.865544 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-9127ca56-c7b0-406b-8c41-2e5f4ac23678 req-d0da7fc8-7c1b-492b-a60f-a6304840b573 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029077 May 12 17:46:33.866314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 140/253] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:34.177709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-656831708", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "networks": [{"uuid": "27ef8398-cbd5-4979-a9fc-e97a3c65d254"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:34.228491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] validate_networks() for [('27ef8398-cbd5-4979-a9fc-e97a3c65d254', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:46:34.315388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:34.316063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:34.322082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.322525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.323292 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.323722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.423397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:34.432955 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-22ae1f10-7756-4e39-aac7-8ef9148089fc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1275 microversion: 2.1 time: 0.121803 May 12 17:46:34.433820 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 141/254] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:34 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:34.561629 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:34.562926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:34.576215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.576665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.577440 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.578430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.619977 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.620453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.620898 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lazy-loading 'fault' on Instance uuid f82d9702-9dfa-42d6-9ffb-efa1acdf9834 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:34.940618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ad11a30da01449f82c1b94c7181860f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887261f594284422bcd448d443d27013', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:34.948251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-80022525-59eb-48d4-9ec0-c722d8765a21 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 200 len: 1304 microversion: 2.1 time: 0.390308 May 12 17:46:34.948844 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 142/255] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:34 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 1304 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:34.954296 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:34.955282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:34.961696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.962149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:34.962924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:34.963381 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.145124 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:46:35.145621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:46:35.146168 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:46:35.147624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:46:35.148053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:46:35.166714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.167165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.167976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.168448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.189186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Getting quotas for project 7ef859014e4d4ff79fb7958511f20d11. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:46:35.194261 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Getting quotas for user 5ad6490c8b8249b1b2abcb0f359330df and project 7ef859014e4d4ff79fb7958511f20d11. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:46:35.208026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:46:35.210305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:46:35.218008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:35.229616 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-066e74f9-1a01-4481-88a9-68fc5f843a91 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1502 microversion: 2.1 time: 0.279753 May 12 17:46:35.230624 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 143/256] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:34 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:35.260545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:35.261159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:35.273508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.274093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.275089 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.275532 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.286891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9a1078c8-2458-4e37-acf8-602cc389b20c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112753 May 12 17:46:35.288505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 114/257] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:46:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:46:35.308373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-517edaee-8d23-4068-a787-d90215202f06 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:35.309532 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-517edaee-8d23-4068-a787-d90215202f06 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:35.396603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-517edaee-8d23-4068-a787-d90215202f06 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:35.404253 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-517edaee-8d23-4068-a787-d90215202f06 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1218 microversion: 2.1 time: 0.106539 May 12 17:46:35.405940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 115/258] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:35 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:35.452349 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:35.453760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:35.464238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.464694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.465773 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.466416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.511206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:35.519232 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cd13e1cc-8bf8-42e1-896c-a8f0512f8752 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1517 microversion: 2.1 time: 0.262878 May 12 17:46:35.519790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 144/259] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:35 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:35.588789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:35.598646 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-222276a4-6e81-4735-b871-46e1ac8ffccc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1273 microversion: 2.1 time: 0.150130 May 12 17:46:35.599156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 116/260] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:35 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:35.967855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:35.969098 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] [instance: f82d9702-9dfa-42d6-9ffb-efa1acdf9834] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:35.976312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.976596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:35.977519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:35.978046 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.012840 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] HTTP exception thrown: Instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 could not be found. May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Request method failure captured: May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 HTTP/1.1 May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUe77v4IFA55JTzZdybmxUlmffhxXRhy1oiI1GZ46CB2SnRh5Uu-VHD7f4T11ztHDJewGG6KRKJeWl0Tw8tbLZJ92NGnR8tVuWHMKBQ7Os2YU4up84rKyYV-cH_lAB3cjOkshtrY6bQ8gwPSTXNPP5IAeh5xWSpLxgJTTECdjGq9MCI May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 887261f594284422bcd448d443d27013 May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesActionsTest-1696156669 May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:46:36.017282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/887261f594284422bcd448d443d27013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/887261f594284422bcd448d443d27013"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/887261f594284422bcd448d443d27013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_887261f594284422bcd448d443d27013", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesActionsTest-1696156669 May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 887261f594284422bcd448d443d27013 May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesActionsTest-1696156669 May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesActionsTest-1696156669-project May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 9ad11a30da01449f82c1b94c7181860f May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesActionsTest-1696156669-project May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 could not be found. May 12 17:46:36.018815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'f82d9702-9dfa-42d6-9ffb-efa1acdf9834'} May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 could not be found. May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:36.019563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 could not be found. May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 could not be found. May 12 17:46:36.020894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:36.024464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] Returning 404 to user: Instance f82d9702-9dfa-42d6-9ffb-efa1acdf9834 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:36.025408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-650cced2-8006-4837-af5e-1d30023c90b1 tempest-VolumesActionsTest-1696156669 tempest-VolumesActionsTest-1696156669-project] 10.222.0.73 "GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834" status: 404 len: 111 microversion: 2.1 time: 0.061944 May 12 17:46:36.026715 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 145/261] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:35 2022] GET /compute/v2.1/servers/f82d9702-9dfa-42d6-9ffb-efa1acdf9834 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:36.423944 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:36.424640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:36.435960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:36.436469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.437687 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:36.438313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.541456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:36.554768 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ca91d319-cee7-4471-8087-be5379daf9ac tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1270 microversion: 2.1 time: 0.134931 May 12 17:46:36.564558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 117/262] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:36 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:36.616233 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:36.616978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:36.627360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:36.627861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.628712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:36.629161 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:36.991482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:36.992776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:37.007218 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.007689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.008595 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.008996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.040282 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lazy-loading 'flavor' on Instance uuid 8a324263-603c-4a73-b819-232273b7c0bb {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:37.147028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:37.158115 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-59e8d49a-d056-49c3-985f-706abfd32ffc tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.546614 May 12 17:46:37.176879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 146/263] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:36 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:37.216667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4f9b694d-db4b-48f2-87cd-1e6d87bb9c0b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/action" status: 200 len: 32 microversion: 2.1 time: 0.231177 May 12 17:46:37.217296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 118/264] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:46:36 2022] POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 17:46:37.226286 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:37.226890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:37.232649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.233094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.234568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.235161 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.414952 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-1cbd3403-4917-4295-bd1b-9232d97bb0a0 req-0a48500b-68fb-44e2-9499-a0babc57f8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7266f170-d323-4b72-a63f-b13bd46106a8", "tag": "14bde056-fbaf-49dc-8239-db356e8be65c"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:37.427046 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1cbd3403-4917-4295-bd1b-9232d97bb0a0 req-0a48500b-68fb-44e2-9499-a0babc57f8bc service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.428206 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-1cbd3403-4917-4295-bd1b-9232d97bb0a0 req-0a48500b-68fb-44e2-9499-a0babc57f8bc service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.449064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-1cbd3403-4917-4295-bd1b-9232d97bb0a0 req-0a48500b-68fb-44e2-9499-a0babc57f8bc service nova] Creating event network-changed:14bde056-fbaf-49dc-8239-db356e8be65c for instance 7266f170-d323-4b72-a63f-b13bd46106a8 on hv-cinder-84052 May 12 17:46:37.455182 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-1cbd3403-4917-4295-bd1b-9232d97bb0a0 req-0a48500b-68fb-44e2-9499-a0babc57f8bc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045995 May 12 17:46:37.456481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 119/265] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:37.461172 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:37.472075 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-af599cfd-91a4-46cf-b8e5-ff18a3f27828 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.249454 May 12 17:46:37.478369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 147/266] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:37 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:37.573532 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:37.574332 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:37.581585 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.582082 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.583101 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:37.583607 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:37.722168 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:37.729495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2626ccf4-c607-4b25-b9b6-cb001689a7e0 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.160906 May 12 17:46:37.730226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 120/267] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:37 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:38.179146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:38.179775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:38.185747 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.186237 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.187036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.187502 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.315830 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:38.323048 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d42e96fe-1ec4-4729-92b9-97bfe46ef338 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.147748 May 12 17:46:38.323607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 148/268] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:38 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:38.488555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:38.489089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:38.495358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.495812 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.496611 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.497051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.630775 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:38.638071 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-430b8f7e-cf1d-40c8-939f-21d73f0914f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.153494 May 12 17:46:38.638638 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 121/269] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:38 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:38.746679 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:38.747220 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:38.753910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.754361 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.755416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:38.755851 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:38.886155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:38.894675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-22c0f16a-5de1-437b-9c24-e0b2eea23001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.151816 May 12 17:46:38.895397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 149/270] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:38 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:39.339694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:39.340375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:39.347317 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.347773 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.348594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.349041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.475569 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:39.482841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d86b3a4b-e402-42e6-989e-959d2958486b tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.146979 May 12 17:46:39.483630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 122/271] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:39 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:39.656093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:39.656752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:39.662703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.663153 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.663921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.664397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.800037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:39.807199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b246e939-9d7d-41f6-939f-12271cde24a1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.155264 May 12 17:46:39.807770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 150/272] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:39 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:39.913118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:39.913937 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:39.920588 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.921047 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:39.922505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:39.922971 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.207960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:40.218597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4b6f2789-f345-4fc5-b634-daa06b81acbc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.309999 May 12 17:46:40.219553 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 123/273] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:39 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:40.500389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:40.501253 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:40.512011 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.512635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.516505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.516505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.654699 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:40.662830 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5dba6a4e-bb2b-49ee-8aac-96c0b3aaa869 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.167169 May 12 17:46:40.663416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 151/274] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:40 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:40.738107 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-2e0ece6b-5d88-4216-92d4-627708a740eb req-fb6e1c0d-c100-4108-b98a-88af2963a89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5fc433-fe1c-47fa-b31c-fea85a6c25a5", "tag": "90a3053b-ee33-4c0a-a3ac-73e9c7651517"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:40.745881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2e0ece6b-5d88-4216-92d4-627708a740eb req-fb6e1c0d-c100-4108-b98a-88af2963a89e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.746324 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-2e0ece6b-5d88-4216-92d4-627708a740eb req-fb6e1c0d-c100-4108-b98a-88af2963a89e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.760229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-2e0ece6b-5d88-4216-92d4-627708a740eb req-fb6e1c0d-c100-4108-b98a-88af2963a89e service nova] Creating event network-changed:90a3053b-ee33-4c0a-a3ac-73e9c7651517 for instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 on hv-cinder-84052 May 12 17:46:40.765151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-2e0ece6b-5d88-4216-92d4-627708a740eb req-fb6e1c0d-c100-4108-b98a-88af2963a89e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031152 May 12 17:46:40.765754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 124/275] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:40.825863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:40.826393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:40.832537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.832998 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.833874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:40.834316 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:40.966008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:40.973712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bd19b679-9ae9-4aee-a154-3676478a45a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.151972 May 12 17:46:40.974280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 152/276] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:40 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:41.236238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:41.236926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:41.243033 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.243467 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.244257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.244700 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.376867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:41.384124 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-00466f56-585e-4eaa-bc35-ba4466d13651 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.153069 May 12 17:46:41.384714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 125/277] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:41 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:41.679937 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:41.680582 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:41.686390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.686832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.687588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.688019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.813789 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:41.820975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4ed275f6-9864-4620-887b-549008b59745 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.144868 May 12 17:46:41.821926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 153/278] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:41 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:41.991270 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:41.991797 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:41.997581 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.998028 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:41.998785 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:41.999469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.127038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:42.134213 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ab690ece-68aa-45a5-aabf-1f76f75d63ca tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.146811 May 12 17:46:42.134782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 126/279] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:41 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:42.400861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:42.401468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:42.407399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:42.407849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.408644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:42.409083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.532809 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:42.540368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4f15af8c-4eb7-4097-8c02-a29259fe6d0e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.143281 May 12 17:46:42.540954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 154/280] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:42 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:42.838001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:42.838512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:42.845256 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:42.845716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.846460 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:42.846893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:42.979139 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:42.987279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-271a0f79-49c2-4673-a6ee-b199f91390a2 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.153221 May 12 17:46:42.987878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 127/281] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:42 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:43.151485 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:43.152099 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:43.159152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:43.159659 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:43.160550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:43.161045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:43.297008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:43.315563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-515344aa-e9c8-47e2-81f2-b2610a06292f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.167935 May 12 17:46:43.316146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 155/282] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:43 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:43.559440 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:43.560229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:43.568741 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:43.569198 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:43.570010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:43.570452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:43.723976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:43.731414 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b9933133-77ec-40e0-ad07-56ad0f03864b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.175820 May 12 17:46:43.731984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 128/283] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:43 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:44.005268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:44.005872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:44.011591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.012045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.012862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.013306 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.136324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:44.143636 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-df86e663-0010-434a-baff-37ec4d3f9c2d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.143413 May 12 17:46:44.144217 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 156/284] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:43 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:44.333496 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:44.334116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:44.340095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.340577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.341391 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.341836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.479413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:44.487736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c7bed1f3-5bfb-4392-8627-4aa2d152ebe8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.159217 May 12 17:46:44.488343 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 129/285] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:44 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:44.748494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:44.749103 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:44.755682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.756132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.756925 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:44.757367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:44.884780 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:44.892280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bcb2a349-b292-4df4-aefd-173ccd100369 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.147609 May 12 17:46:44.893506 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 157/286] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:44 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:45.167739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:45.168488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:45.175143 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.175735 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.176698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.177172 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.334770 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:45.352695 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec105e67-f81f-4fb3-b4e5-e44f69b236ac tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.194797 May 12 17:46:45.353907 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 130/287] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:45 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:45.510465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:45.511500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:45.520849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.521698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.523228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.523874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.750864 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:45.759040 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8bab90af-e7fc-479c-8345-3e130d37bd80 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.255692 May 12 17:46:45.760267 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 158/288] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:45 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:45.913949 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:45.915268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:45.924757 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.925794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:45.926760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:45.927195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.108538 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:46.117811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-21e2f716-91bf-4906-ade7-8f569282b567 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.211501 May 12 17:46:46.118675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 131/289] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:45 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:46.385863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:46.387125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:46.397223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:46.397910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.399515 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:46.401280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.493074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:46.494822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:46.503402 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:46.504429 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.505382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:46.505984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.538241 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-51fd30e1-37b8-4bc1-9555-2e6e60375d43 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/ips" status: 200 len: 151 microversion: 2.20 time: 0.049135 May 12 17:46:46.539450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 132/290] 10.222.0.73 () {60 vars in 1288 bytes} [Thu May 12 17:46:46 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:46:46.620084 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:46.634371 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-387c4a42-b801-4c8b-a321-7abebe1cd4fd tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.267014 May 12 17:46:46.635555 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 159/291] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:46 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:46.777037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:46.777678 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:46.784550 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:46.785129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.786069 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:46.786619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:46.984507 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:46.994275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f9f6bcb6-a78a-4e88-9098-32cb74fa344a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.221071 May 12 17:46:46.994860 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 133/292] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:46 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:47.135608 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:47.136342 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:47.142784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.143246 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.144029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.144499 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.285054 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:47.292594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6fe090d9-16d8-4664-8bcc-ccb197004001 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.161190 May 12 17:46:47.293292 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 160/293] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:47 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:47.655163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:47.655995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:47.665107 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.668591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.669585 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.673791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.734155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-0c7822e9-48c7-4ca2-abbd-b351d7f65084 req-78b9575a-0c86-404e-b756-34762ae9e245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7266f170-d323-4b72-a63f-b13bd46106a8", "name": "network-vif-plugged", "status": "completed", "tag": "14bde056-fbaf-49dc-8239-db356e8be65c"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:47.746942 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-0c7822e9-48c7-4ca2-abbd-b351d7f65084 req-78b9575a-0c86-404e-b756-34762ae9e245 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:47.749979 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-0c7822e9-48c7-4ca2-abbd-b351d7f65084 req-78b9575a-0c86-404e-b756-34762ae9e245 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:47.778924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-0c7822e9-48c7-4ca2-abbd-b351d7f65084 req-78b9575a-0c86-404e-b756-34762ae9e245 service nova] Creating event network-vif-plugged:14bde056-fbaf-49dc-8239-db356e8be65c for instance 7266f170-d323-4b72-a63f-b13bd46106a8 on hv-cinder-84052 May 12 17:46:47.787405 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-0c7822e9-48c7-4ca2-abbd-b351d7f65084 req-78b9575a-0c86-404e-b756-34762ae9e245 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057019 May 12 17:46:47.788745 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 161/294] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:47.948260 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:47.957001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fccb17cb-6069-456d-a367-f6c0dd5b80fe tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.305884 May 12 17:46:47.964340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 134/295] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:47 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:48.017591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:48.018727 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.037285 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.038100 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.039611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.040609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.229003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:48.242482 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-88cc1b9c-4252-4511-bbdb-50855d2d7b64 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.231395 May 12 17:46:48.245680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 162/296] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:48 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:48.308676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:48.309289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.328074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.328584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.329442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.330448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.554454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:48.570167 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6bcdef27-8312-49ef-bd1f-93f0e2d04ff7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.265137 May 12 17:46:48.571045 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 135/297] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:48 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:48.953665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:48.954205 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.966274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.966653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.967435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.967873 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.980196 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:48.981011 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:48.988279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.989518 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:48.990431 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:48.990981 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.002803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lazy-loading 'flavor' on Instance uuid 022cd56e-632d-4336-a6d1-4de0c1952705 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:46:49.171034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:49.179302 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a40d3ad3-cfcc-49bf-b71f-dd8def0a39e9 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1315 microversion: 2.1 time: 0.203183 May 12 17:46:49.180197 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 136/298] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:48 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:49.264234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:49.264794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:49.271600 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.272192 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.273117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.273679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.487085 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-419c1f5b-30d2-4029-bdf5-21a6dc2ce98e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/action" status: 202 len: 0 microversion: 2.20 time: 0.541032 May 12 17:46:49.488741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 163/299] 10.222.0.73 () {62 vars in 1318 bytes} [Thu May 12 17:46:48 2022] POST /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:49.513137 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:49.516307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:49.532094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.534599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:49.536398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:49.537044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.038008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.051813 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c21de9e9-824d-4ae2-9f6b-b09f4a291953 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.792738 May 12 17:46:50.052836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 137/300] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:49 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:50.072279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:50.073269 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:50.076258 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.085302 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.086234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.087412 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.088032 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.088140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.090028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.091733 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9a3e2c40-6a16-4fff-9468-467aff2ac361 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.598104 May 12 17:46:50.093285 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 164/301] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:49 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:50.099438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-246b4b9a-1599-4995-9dc2-0310c7322de5 req-d6f018e7-ad10-4d40-ae36-7b7453cf9528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5fc433-fe1c-47fa-b31c-fea85a6c25a5", "name": "network-vif-plugged", "status": "completed", "tag": "90a3053b-ee33-4c0a-a3ac-73e9c7651517"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:50.148545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-246b4b9a-1599-4995-9dc2-0310c7322de5 req-d6f018e7-ad10-4d40-ae36-7b7453cf9528 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.149125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-246b4b9a-1599-4995-9dc2-0310c7322de5 req-d6f018e7-ad10-4d40-ae36-7b7453cf9528 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.207892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-246b4b9a-1599-4995-9dc2-0310c7322de5 req-d6f018e7-ad10-4d40-ae36-7b7453cf9528 service nova] Creating event network-vif-plugged:90a3053b-ee33-4c0a-a3ac-73e9c7651517 for instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 on hv-cinder-84052 May 12 17:46:50.241991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-246b4b9a-1599-4995-9dc2-0310c7322de5 req-d6f018e7-ad10-4d40-ae36-7b7453cf9528 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133674 May 12 17:46:50.243741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 165/302] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:50.258998 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:50.264188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:50.279635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.279635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.286479 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.292485 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.315878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.326619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b67dd5d5-9935-4bca-b946-40911a372e56 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.271667 May 12 17:46:50.327748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 138/303] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:50 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:50.491910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.505720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c59cb906-ebea-4bac-8132-95276c5a8d25 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1465 microversion: 2.1 time: 0.251848 May 12 17:46:50.506935 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 166/304] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:50 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1465 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:50.557714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:50.558448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:50.565571 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.566516 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.567511 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.567949 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.607666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:46:50.732416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-203eefed-0d09-404a-900d-4b5c2800c5e8 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 204 len: 0 microversion: 2.1 time: 0.182015 May 12 17:46:50.733506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 139/305] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:46:50 2022] DELETE /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:46:50.743384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:50.744088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:50.754468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.755204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.756193 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:50.756825 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:50.920816 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:50.935102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-badb8be1-24ae-49e5-bad8-22e78417c1e3 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1471 microversion: 2.1 time: 0.195950 May 12 17:46:50.938341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 167/306] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:50 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:51.071607 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.073768 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.082476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.084096 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.085173 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.085835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.111613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.112866 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.129092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.130286 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.132043 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.133248 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.418545 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.430229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a98d1b86-d5b9-481e-9afe-c8183f0fc44a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.363608 May 12 17:46:51.441419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 140/307] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:51.442589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.443205 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.461844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.462297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.463093 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.467419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.538698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.572436 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.581631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.585668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a1b7e4bf-8a9d-46a6-97a1-46291a067874 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.476194 May 12 17:46:51.591818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 168/308] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:51.679802 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:51.688228 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d08913b3-e238-413d-878e-aeb31637596b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.253504 May 12 17:46:51.689522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 141/309] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:51.953701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:51.954312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:51.961427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.962420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:51.964351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:51.964904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.122929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.132135 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-41a4bfc2-4d10-4862-b555-7de7ab18b8a4 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1471 microversion: 2.1 time: 0.182165 May 12 17:46:52.134036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 169/310] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:51 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:52.450330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:52.450947 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:52.459746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.460652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.461571 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.462113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.605641 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:52.606251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:52.611761 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.619334 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.619458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.620144 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.620615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.627676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8dcdaae1-b244-4cf8-acc4-45d9cfe6edf7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.182347 May 12 17:46:52.628289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 142/311] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:52 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:52.711024 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:52.711633 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:52.718318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.718770 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.719586 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:52.720187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:52.755311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.766243 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.770738 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.772146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f6720e11-3fa1-4b21-a175-c5c764c17d7f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.170355 May 12 17:46:52.772886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 170/312] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:52 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:52.851609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:52.859231 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7a8048d9-4e5f-400c-a98f-012014955033 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.151940 May 12 17:46:52.859805 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 143/313] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:52 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:53.151768 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:53.152390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:53.160923 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.161700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.162638 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.163362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.307134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:53.315440 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-274cf7e6-d220-49c1-9fa0-88cb031e859d tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1471 microversion: 2.1 time: 0.168450 May 12 17:46:53.316338 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 171/314] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:53 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:46:53.652157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:53.655985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:53.674336 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.675716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.677995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.679290 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.800840 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:53.803249 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:53.834591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.835564 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:53.846277 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:53.847275 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.147838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.162646 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-572cd271-1ae5-4052-bfb8-a91e554975f4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.518929 May 12 17:46:54.167990 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 144/315] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:53 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:54.176773 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.186083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.186345 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:54.187305 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:54.187599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.189017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-37fda42c-0f46-4384-963a-c1ce33595ef1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.400145 May 12 17:46:54.190073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 172/316] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:53 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:46:54.195663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.196377 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.197310 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.197962 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.292247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7ff84fa6-c7eb-4250-acd5-70bd28297f55 req-1d22956b-68fc-4c5b-bbfc-40e027a33e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7266f170-d323-4b72-a63f-b13bd46106a8", "name": "network-vif-deleted", "tag": "14bde056-fbaf-49dc-8239-db356e8be65c"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:54.301431 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7ff84fa6-c7eb-4250-acd5-70bd28297f55 req-1d22956b-68fc-4c5b-bbfc-40e027a33e4f service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.301879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7ff84fa6-c7eb-4250-acd5-70bd28297f55 req-1d22956b-68fc-4c5b-bbfc-40e027a33e4f service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.318419 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7ff84fa6-c7eb-4250-acd5-70bd28297f55 req-1d22956b-68fc-4c5b-bbfc-40e027a33e4f service nova] Creating event network-vif-deleted:14bde056-fbaf-49dc-8239-db356e8be65c for instance 7266f170-d323-4b72-a63f-b13bd46106a8 on hv-cinder-84052 May 12 17:46:54.324355 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-7ff84fa6-c7eb-4250-acd5-70bd28297f55 req-1d22956b-68fc-4c5b-bbfc-40e027a33e4f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 May 12 17:46:54.333151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 173/317] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:46:54.341231 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:54.342178 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:54.367087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.369371 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.370419 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:54.370899 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:54.378645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.390295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-382a03f6-b6f5-48d2-87f3-c49d923435ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1318 microversion: 2.1 time: 0.218585 May 12 17:46:54.401721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 145/318] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:54 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:54.477005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e95c3d471634389a70bfcd7515085ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e53ce05ac35c48aeb17842025bb4c455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:54.484750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9eb6a07f-fb7f-41dd-9412-d6095e78b955 tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 200 len: 1429 microversion: 2.1 time: 0.149386 May 12 17:46:54.485632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 174/319] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:54 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 1429 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:55.185408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:55.186681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:55.204103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.205876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.206910 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.207307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:55.207922 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:55.211226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.223448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.223907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.224721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.225157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.547054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.555247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f8617ec8-f3b2-4148-820b-048ed8c7b371 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.373773 May 12 17:46:55.567121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 146/320] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:55 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:55.571989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:55.572641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:55.600784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.603856 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.607131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.608553 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.638895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.656606 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.658685 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.660398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3c99ac5a-2472-42db-bac3-3038ff75ce50 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.457271 May 12 17:46:55.671279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 175/321] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:55 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:46:55.676876 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:55.677519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] [instance: 7266f170-d323-4b72-a63f-b13bd46106a8] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:55.687401 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.687854 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.688665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:55.689973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:55.714793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] HTTP exception thrown: Instance 7266f170-d323-4b72-a63f-b13bd46106a8 could not be found. May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Request method failure captured: May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 HTTP/1.1 May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUf0AwbwoThWX2GsldRpizpNgBJnkbQgeQMGvcBgFyW3g3wgA1xeqgCRNfO1R-8R8jDNsacnT1LwaO1B29Qbkhgz1jb9CfDiHiowkUAxEXEFFIICAlISVkuE1sWd7HPbxlVisjnvO6M014Ef5QF5obaXUGCJDz6Jd6Ng-u_NSh1ooNI May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: e53ce05ac35c48aeb17842025bb4c455 May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesNegativeTest-2003618337 May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:46:55.717104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/e53ce05ac35c48aeb17842025bb4c455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e53ce05ac35c48aeb17842025bb4c455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e53ce05ac35c48aeb17842025bb4c455"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_e53ce05ac35c48aeb17842025bb4c455", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesNegativeTest-2003618337 May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: e53ce05ac35c48aeb17842025bb4c455 May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesNegativeTest-2003618337 May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesNegativeTest-2003618337-project May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 2e95c3d471634389a70bfcd7515085ae May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesNegativeTest-2003618337-project May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 7266f170-d323-4b72-a63f-b13bd46106a8 could not be found. May 12 17:46:55.718599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '7266f170-d323-4b72-a63f-b13bd46106a8'} May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7266f170-d323-4b72-a63f-b13bd46106a8 could not be found. May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:46:55.719531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7266f170-d323-4b72-a63f-b13bd46106a8 could not be found. May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7266f170-d323-4b72-a63f-b13bd46106a8 could not be found. May 12 17:46:55.720770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:46:55.721770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] Returning 404 to user: Instance 7266f170-d323-4b72-a63f-b13bd46106a8 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:46:55.721770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c49877d1-ef50-4456-9510-5d054692ceec tempest-VolumesNegativeTest-2003618337 tempest-VolumesNegativeTest-2003618337-project] 10.222.0.73 "GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8" status: 404 len: 111 microversion: 2.1 time: 0.050057 May 12 17:46:55.721770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 176/322] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:55 2022] GET /compute/v2.1/servers/7266f170-d323-4b72-a63f-b13bd46106a8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:46:55.937115 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:55.951329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3ea96f14-5627-4794-aaff-ed005bed98c3 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1507 microversion: 2.1 time: 0.381162 May 12 17:46:55.954170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 147/323] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:55 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:56.385998 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:56.387078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:56.398792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.399236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.400026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.400487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.469037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9388c25f-9aa5-47bc-9f48-395e0bd72818 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/ips" status: 200 len: 148 microversion: 2.1 time: 0.088119 May 12 17:46:56.473494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 177/324] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:46:56 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/ips => generated 148 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:56.578257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:56.579247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:56.607296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.609834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.634946 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.637036 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.679314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:56.680072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:56.695652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.699174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:56.706517 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:56.708452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:57.204025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:57.217590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:57.222498 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:57.226188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2e747365-d9d6-425c-867b-c03359556839 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.550796 May 12 17:46:57.227817 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 178/325] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:56 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:46:57.239722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:57.249630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-03f8c1fd-cdfd-47a6-93c7-d11c01ebd7f9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.676304 May 12 17:46:57.251448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 148/326] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:56 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:58.139410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dada5f22-9ecf-46b6-8341-e763ae5f2b39"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:46:58.141337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:58.149020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.151730 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.152551 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.154855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.246437 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:58.247957 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:58.267790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.269575 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.270859 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.271796 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.545747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:58.560775 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:58.565245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:58.568930 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9772f947-ab9d-4ea7-8784-90369aedd2c7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.325513 May 12 17:46:58.570960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 149/327] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:58 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:46:58.597010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:58.597906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:58.630885 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.636539 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.637381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:58.637833 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:58.659794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6aa776d6-2e7f-4b59-bc02-95dd75acb539 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526147 May 12 17:46:58.668588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 179/328] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:46:58 2022] POST /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:46:58.979982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:58.993423 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ed2692d2-b5fd-40d8-a6a7-e33956769358 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.418673 May 12 17:46:58.994675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 150/329] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:46:58 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:46:59.591739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:46:59.592468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:46:59.604258 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:59.604739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:59.605497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:46:59.605964 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:46:59.850136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:59.865530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:59.876888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:46:59.878243 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8dbae3ec-0c94-4824-8790-8e7ef9d92072 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.292574 May 12 17:46:59.879354 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 180/330] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:46:59 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:00.014251 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:00.014979 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:00.028876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.029894 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:00.032013 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.033538 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:00.256915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:00.267237 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bea479ed-aa75-4328-ae5d-73bd47951d9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.258725 May 12 17:47:00.268303 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 151/331] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:00 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:00.899284 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:00.899886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:00.918353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.921294 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:00.924329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:00.925079 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:01.122171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:01.142801 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:01.145779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:01.147610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4c296822-691b-4237-ad48-1afb87745b9b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.252115 May 12 17:47:01.149939 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 181/332] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:00 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:01.285518 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:01.286118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:01.299528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:01.300013 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:01.300870 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:01.301327 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:01.469759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:01.482084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2df5142a-f361-4879-88f7-a8a07a3e7757 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.201209 May 12 17:47:01.482913 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 152/333] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:01 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:02.168147 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:02.169012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:02.175772 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.176365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.177695 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.178325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.336732 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:02.346788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:02.348529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:02.349774 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b85677a0-6ebf-4f0f-b891-6a3b1b77f5b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.186067 May 12 17:47:02.361915 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 182/334] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:02 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:02.498773 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:02.499388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:02.506641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.507101 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.507888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:02.508372 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:02.665555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:02.673563 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5b95b908-357c-403e-8c96-82e353f41522 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.178031 May 12 17:47:02.674707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 153/335] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:02 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:03.371173 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:03.371904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:03.379631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:03.380095 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.380916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:03.381471 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.575365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:03.586417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:03.589525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:03.591056 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bf3101e5-6798-4fcb-bda8-cf2340ae6fe0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.224694 May 12 17:47:03.592104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 183/336] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:03 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:03.691653 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:03.693200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:03.699912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:03.700674 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.701737 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:03.702217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:03.906328 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:03.916747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1f3cceec-de3c-4c77-a27f-8a0060f81edb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.229692 May 12 17:47:03.917614 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 154/337] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:03 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:04.610564 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:04.612493 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:04.619119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.619814 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.621037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.621705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.795534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:04.805008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:04.806762 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:04.808143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2e4412f4-86fb-4c9c-be83-bc152a604c17 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.201596 May 12 17:47:04.808933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 184/338] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:04 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:04.935815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:04.936639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:04.943991 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.945131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:04.946236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:04.946887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:05.121805 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:05.134237 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-59d377b4-bbae-4a4f-b484-6f88c4e3924e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.203493 May 12 17:47:05.134692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 155/339] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:04 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:05.827719 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:05.828943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:05.837545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:05.838347 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:05.839132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:05.839570 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.054536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:06.075087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:06.077379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:06.079882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-86315115-0038-4d9f-9bfb-dffbd52b0a60 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.256123 May 12 17:47:06.081880 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 185/340] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:05 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:06.154649 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:06.155255 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:06.163126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.164282 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.165682 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:06.166404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:06.350388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:06.363054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5df2859d-3c13-4488-9b61-ef3363035c96 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.212029 May 12 17:47:06.372911 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 156/341] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:06 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:07.104869 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:07.106278 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:07.129221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.130082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.131124 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.131612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.326718 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:07.338084 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:07.340742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:07.342633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7ac72147-b97b-4e99-ac3a-2c2c5df76f40 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.247156 May 12 17:47:07.354795 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 186/342] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:07 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:07.389102 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:07.390966 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:07.410413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.411620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.413085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:07.413746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:07.667525 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:07.683267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9816075d-58c8-4d1f-89ec-3b33bafb76df tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.304562 May 12 17:47:07.684609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 157/343] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:07 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:08.363948 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:08.365286 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:08.371540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:08.372426 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.373384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:08.374083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.531547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:08.541464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:08.543012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:08.544369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9bb00b3a-fb19-419b-a9d1-0d154d2317c9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.186398 May 12 17:47:08.545091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 187/344] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:08 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:08.680116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-006fac6d-aa4a-4085-8733-fcf9c77d1d29 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: .version_select at 0x7fc0c648aca0>, body: {"keypair": {"name": "tempest-keypair-1544020638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKPAZJjBvsLXn1res/xji8s3Mj/huMGo7loz8jEHy5+HrJZoOoUxGLsPQ46FFkskX465N8Vqel0UlidMHtiLZKj3pp6sCOG5HqkCBU9NPFM2mW9DxUGsFaGlDvSHMOpCA=="}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:08.700669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:08.701297 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:08.708304 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-006fac6d-aa4a-4085-8733-fcf9c77d1d29 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:47:08.710234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:08.710826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.711615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:08.712053 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:08.720889 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-006fac6d-aa4a-4085-8733-fcf9c77d1d29 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:47:08.760914 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-006fac6d-aa4a-4085-8733-fcf9c77d1d29 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084221 May 12 17:47:08.762111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 158/345] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:47:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:47:08.929969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:08.940674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-95fa4633-09f0-4a31-b080-6b1df3da43b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.244016 May 12 17:47:08.941822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 188/346] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:08 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:09.563397 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:09.564565 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:09.570280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.570733 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.571502 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.571940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.779147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:09.787780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:09.789295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:09.790441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f11931a5-f013-4aa5-adf6-80aefc53a959 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.231031 May 12 17:47:09.790999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 159/347] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:09 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:09.958605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:09.959224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:09.965399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.965841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:09.966607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:09.967045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.159029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:10.166242 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-44caebfa-facf-442b-a1d6-997f9db0b8b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.212110 May 12 17:47:10.166803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 189/348] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:09 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:10.451109 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-721445775", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1221ba24-0e4c-4509-ac6d-bff82c57688b"}], "security_groups": [{"name": "tempest-securitygroup--1681656176"}], "key_name": "tempest-keypair-1544020638", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:10.809566 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:10.810197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:10.817588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:10.818046 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.818842 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:10.819286 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:10.988134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:10.997435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:10.999063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:11.000780 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-311dce95-7f58-4eb7-9af6-5bf06b6e1df3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.195291 May 12 17:47:11.001975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 190/349] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:10 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:11.183232 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:11.183763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:11.189952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:11.190399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:11.191166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:11.191614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:11.339735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:11.348015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9bb1048c-716e-42da-af6c-4b0e21c11993 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.168881 May 12 17:47:11.348678 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 191/350] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:11 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:12.022511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:12.023830 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:12.031563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.032940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.033885 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.034474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.172517 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.180685 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.182181 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.183357 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6e5f555f-713d-4c15-9c14-ebc703513b64 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1745 microversion: 2.20 time: 0.166282 May 12 17:47:12.183916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 192/351] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:12 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:12.364328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:12.364859 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:12.370854 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.371303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.372071 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:12.372529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:12.528820 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:12.546362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6ae53864-b979-4817-80ef-0388d64992c4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.184751 May 12 17:47:12.547324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 193/352] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:12 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:12.818817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] validate_networks() for [('1221ba24-0e4c-4509-ac6d-bff82c57688b', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:47:13.204599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:13.206004 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:13.213074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.213700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.214812 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.215604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.269714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:47:13.270146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:47:13.270624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:47:13.271042 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:47:13.271473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:47:13.282061 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.283644 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.284745 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.285669 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.306330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:47:13.312627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:47:13.334680 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:47:13.338135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:47:13.451884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ebac0553-a308-4d51-aa41-de310c42407c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.005031 May 12 17:47:13.452564 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 160/353] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:47:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:47:13.457282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:13.467610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:13.469999 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:13.475248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-12756a84-a173-4201-a753-34ae472efcd8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:13.476011 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-12756a84-a173-4201-a753-34ae472efcd8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:13.491271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0fa2c781-56bd-4d1a-a879-b97beddf850d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1745 microversion: 2.20 time: 0.287833 May 12 17:47:13.491915 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 194/354] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:13 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1745 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:13.567925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-12756a84-a173-4201-a753-34ae472efcd8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:13.569071 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:13.569773 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:13.578652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.579887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.580268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-12756a84-a173-4201-a753-34ae472efcd8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1241 microversion: 2.1 time: 0.114180 May 12 17:47:13.582621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 161/355] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:13 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:13.587399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:13.587865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:13.731638 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:13.740845 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-178d6631-0c37-4dce-8ed0-0a69ae3d3543 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.178702 May 12 17:47:13.741438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 195/356] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:13 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:14.510340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:14.510958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:14.518098 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.518558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.519339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.519782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.596851 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:14.597464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:14.603883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.604376 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.605156 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.605603 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.658042 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.665909 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.667429 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.668596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-de3ed495-70fb-4721-badf-f16b86473a3f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1745 microversion: 2.20 time: 0.162122 May 12 17:47:14.669159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 162/357] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:14 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:14.676396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.686995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6892f03c-7697-425c-8cd2-e19c2f28f779 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1245 microversion: 2.1 time: 0.094268 May 12 17:47:14.688017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 196/358] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:14 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:14.758489 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:14.759038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:14.764914 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.765369 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.766150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:14.766643 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:14.895118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:14.904481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e26c94e7-f6c6-40e7-8f42-8386312a069d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.149577 May 12 17:47:14.905222 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 163/359] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:14 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:15.687708 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:15.688358 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:15.695347 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.695806 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.696610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.697044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.706232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:15.706840 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:15.713287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.713739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.714519 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.714960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.792754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:15.800547 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3648214a-d36f-4124-94a9-a94bc205c999 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1245 microversion: 2.1 time: 0.098191 May 12 17:47:15.801118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 164/360] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:15 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:15.848033 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:15.856373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:15.857858 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:15.859010 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-67c3c26f-79b4-4965-9ad1-c8c0a31bb9a7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1745 microversion: 2.20 time: 0.175242 May 12 17:47:15.859573 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 197/361] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:15 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:15.921926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:15.922647 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:15.929099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.929549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:15.930310 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:15.930763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.055488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:16.063437 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-44c669c2-d556-48a8-9f0e-90daf8a6e8cd tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.145130 May 12 17:47:16.064117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 165/362] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:15 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:16.816857 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:16.817472 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:16.823691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.824141 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.824946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.825385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.878207 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:16.878845 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:16.885483 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.885941 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.886727 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:16.887172 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:16.887431 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:16.894773 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ce15a5ff-b410-4af2-b3df-d06b9d311950 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1293 microversion: 2.1 time: 0.082386 May 12 17:47:16.895348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 198/363] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:16 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:17.024115 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:17.031776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:17.034060 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:17.035574 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ad76ed7a-0284-4d01-b0ea-16f9cc030f97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1745 microversion: 2.20 time: 0.162531 May 12 17:47:17.036135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 166/364] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:16 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:17.080691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:17.081394 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:17.087293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:17.087752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:17.088565 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:17.089004 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:17.223586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:17.231165 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-939ba75d-ab59-43dd-8535-e212610e8979 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.154624 May 12 17:47:17.231735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 199/365] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:17 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:17.914774 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:17.915722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:17.927108 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:17.927562 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:17.932902 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:17.933353 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.056454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:18.057683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:18.091016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.093408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.103005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.103938 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.533347 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:18.544329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8a83b0c2-4c76-4c18-9357-ca15c6e96717 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1301 microversion: 2.1 time: 0.635612 May 12 17:47:18.554898 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 167/366] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:17 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1301 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:18.559064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:18.560002 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:18.588742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.588742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.588742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.588742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.808934 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:18.824154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:18.825706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:18.826878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-190bb8c4-34f6-47e6-b121-a3aac91df433 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.776316 May 12 17:47:18.827448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 200/367] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:18 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:18.832060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-f6406b97-1a06-4772-a486-e2e4663c4091 req-9fb52bcc-a8e7-4082-88ff-15ffa6badf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:18.869352 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f6406b97-1a06-4772-a486-e2e4663c4091 req-9fb52bcc-a8e7-4082-88ff-15ffa6badf2b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:18.870011 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f6406b97-1a06-4772-a486-e2e4663c4091 req-9fb52bcc-a8e7-4082-88ff-15ffa6badf2b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:18.887950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-f6406b97-1a06-4772-a486-e2e4663c4091 req-9fb52bcc-a8e7-4082-88ff-15ffa6badf2b service nova] Creating event network-vif-plugged:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:47:18.895897 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-f6406b97-1a06-4772-a486-e2e4663c4091 req-9fb52bcc-a8e7-4082-88ff-15ffa6badf2b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066634 May 12 17:47:18.897265 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 201/368] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:18.910202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:18.920331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-be6433ce-9a69-4463-8d0a-9f465033b40f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.372335 May 12 17:47:18.921627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 168/369] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:18 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:19.565670 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:19.566107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:19.575260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.575712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.576607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.577101 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.691314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:19.709008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e31686b9-ce2d-4b02-a86b-79a006aa4044 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1299 microversion: 2.1 time: 0.149794 May 12 17:47:19.712833 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 202/370] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:19 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:19.853287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:19.854670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:19.864943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.865728 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.866833 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.867441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.938892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:19.940103 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:19.955009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.956157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:19.957205 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:19.962969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:20.411781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:20.434399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:20.440520 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:20.441797 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b689f5aa-809b-4ee6-aaf7-8ed4d3778667 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.596174 May 12 17:47:20.446192 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 169/371] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:19 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:20.623875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:20.637268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a1ab50c2-f889-435c-833d-bb91774b1179 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.702194 May 12 17:47:20.648559 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 203/372] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:19 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:20.731182 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:20.743797 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:20.763103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:20.769780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:20.772876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:20.773333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:21.151551 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:21.162782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a72e0e95-b20e-47c7-9127-58d72c00be8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.435588 May 12 17:47:21.166584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 170/373] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:20 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:21.462051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:21.462706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:21.470762 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:21.478266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:21.479128 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:21.479577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:21.668032 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:21.668709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:21.691881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:21.694075 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:21.695070 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:21.698631 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.035818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.049278 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.050813 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.052029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0badb9f2-270d-4be1-a864-0198189bdb09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.594093 May 12 17:47:22.067826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 204/374] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:21 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:22.085484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-0396f95f-305c-4e6d-a6c0-adc76477eae8 req-39560aa5-d79a-475a-bccd-63a69b0ad65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d5ca9d-5ce9-496f-ae0c-1e2836506652", "tag": "77239c9b-45a3-42cb-94e9-552e3cd10f35"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:22.128951 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-0396f95f-305c-4e6d-a6c0-adc76477eae8 req-39560aa5-d79a-475a-bccd-63a69b0ad65b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.129639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-0396f95f-305c-4e6d-a6c0-adc76477eae8 req-39560aa5-d79a-475a-bccd-63a69b0ad65b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.151005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-0396f95f-305c-4e6d-a6c0-adc76477eae8 req-39560aa5-d79a-475a-bccd-63a69b0ad65b service nova] Creating event network-changed:77239c9b-45a3-42cb-94e9-552e3cd10f35 for instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 on hv-cinder-84052 May 12 17:47:22.165952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-0396f95f-305c-4e6d-a6c0-adc76477eae8 req-39560aa5-d79a-475a-bccd-63a69b0ad65b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096740 May 12 17:47:22.166584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 205/375] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:22.169862 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.182825 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4b597a15-2e91-48d3-b24c-6e0cf6f28d35 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1503 microversion: 2.1 time: 0.518536 May 12 17:47:22.201641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 171/376] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:21 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1503 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:22.214875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:22.219943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:22.222476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71cba15b-257e-40e6-848d-e325b129ff50"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:22.227375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:22.238490 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.240992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.242745 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.244133 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.244751 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.245373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.247417 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.249657 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.301886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] HTTP exception thrown: Cannot 'attach_volume' instance 8a324263-603c-4a73-b819-232273b7c0bb while it is in vm_state rescued May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Request method failure captured: May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/os-volume_attachments HTTP/1.1 May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 74 May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUempJqBkrdawMuXNw3bGhubgy7zT209G1Bw9kNOHCSoGyVqSk_JWhDZZpbuaiXR30BdGwKWbBfZiXLWF7aKv0vNq5w5HClxXzYWwsjn4NnUaRe4jnNLfpORFw2f_MVLsgh55kz6SOlGxBxFgOpCHXmodxJyhzFc3hsxLtyhwbwsyr8 May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:47:22.303628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_202db80dae2446e2b9cd1124b2925ced", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 298a13924a864f61adf6e4085e569358 May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {"volumeAttachment": {"volumeId": "71cba15b-257e-40e6-848d-e325b129ff50"}} May 12 17:47:22.304999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Cannot 'attach_volume' instance 8a324263-603c-4a73-b819-232273b7c0bb while it is in vm_state rescued May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'server_id': '8a324263-603c-4a73-b819-232273b7c0bb', 'body': {'volumeAttachment': {'volumeId': '71cba15b-257e-40e6-848d-e325b129ff50'}}} May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a324263-603c-4a73-b819-232273b7c0bb in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:47:22.305763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8a324263-603c-4a73-b819-232273b7c0bb while it is in vm_state rescued May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:47:22.306950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:47:22.308109 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:47:22.308109 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:47:22.308109 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8a324263-603c-4a73-b819-232273b7c0bb while it is in vm_state rescued May 12 17:47:22.308109 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:47:22.308426 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Returning 409 to user: Cannot 'attach_volume' instance 8a324263-603c-4a73-b819-232273b7c0bb while it is in vm_state rescued {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:47:22.309169 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-df0a044c-74f2-4d87-aa87-ccc9f1ced081 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105616 May 12 17:47:22.311383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 172/377] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:47:22 2022] POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/os-volume_attachments => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 17:47:22.331148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:22.338233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:22.353893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.354408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.355192 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.355800 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.469405 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9cb772ec-26c8-4465-b6e0-d913141455c1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.140099 May 12 17:47:22.469864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 173/378] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:47:22 2022] POST /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:47:22.477208 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:22.478283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:22.485753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.486706 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.488751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:22.489482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:22.606885 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.630480 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5a4b1b6f-a7a4-42f6-9824-01811b23deb1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.448909 May 12 17:47:22.636300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 206/379] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:22 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:22.843622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:22.854363 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-909b920a-f981-4dc3-9104-c4baf19e1b38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.381948 May 12 17:47:22.864526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 174/380] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:22 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:23.074600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:23.075184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:23.108932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.111745 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.117752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.119224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.463621 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:23.477550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:23.479282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:23.480503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e739d212-45c9-44a2-80fb-9636c3fdf8eb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.412820 May 12 17:47:23.481738 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 207/381] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:23 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:23.653624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:23.654243 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:23.668749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.673410 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.675237 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.676057 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.872142 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:23.873689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:23.874316 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:23.883527 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.883993 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.884817 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:23.886227 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:23.888436 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7cf3f0ac-8a6f-4f3d-b69b-f0a0564f1785 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.238896 May 12 17:47:23.894764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 175/382] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:23 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:24.061099 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:24.079078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2c569d15-2d88-4c30-bea0-5b4cb12e6816 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.202035 May 12 17:47:24.082234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 208/383] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:23 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:24.501093 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:24.503881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:24.510926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.511818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.513917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.514718 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.698996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:24.709724 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:24.711508 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:24.712877 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-401b6fe8-b770-4ed6-8080-309382b98b8f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.216069 May 12 17:47:24.725540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 176/384] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:24 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:24.909333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:24.910856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:24.922480 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.923505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:24.942580 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:24.947564 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:25.092316 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:25.099742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:25.100493 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:25.101421 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f81e3222-872e-43ac-ac35-50ad003bb750 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.198375 May 12 17:47:25.107347 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:25.107874 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:25.108783 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:25.109295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:25.110969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 209/385] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:24 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:25.259240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:25.266682 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d4ad5146-6c60-4583-b9b7-2dcc21e687ec tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.171794 May 12 17:47:25.267248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 177/386] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:25 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:25.732450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:25.733408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:25.740415 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:25.740994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:25.741870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:25.742379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:25.887832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:25.896761 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:25.899940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:25.901146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-887b28b9-caee-43c4-8453-781cb49e284d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.172611 May 12 17:47:25.909878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 210/387] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:25 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:26.118683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:26.119329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:26.125907 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.127151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.128270 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.128924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.275902 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:26.284351 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b398b72e-a868-4758-b4a8-cf997cb5616a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.169612 May 12 17:47:26.285117 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:26.285726 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:26.292615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.293465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.294396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.294872 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 178/388] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:26 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:26.295008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.444063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:26.456191 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ced63a6-935a-47f0-9aae-735796373080 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.175492 May 12 17:47:26.456777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 211/389] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:26 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:26.922516 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:26.928296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:26.943338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.943831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:26.944654 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:26.949021 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.145801 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:27.155915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:27.157720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:27.159943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c703ed43-f744-434e-b19e-e1422b399285 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.243643 May 12 17:47:27.161079 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 179/390] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:26 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:27.302624 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:27.303961 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:27.310987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:27.311758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.312781 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:27.313223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.459089 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:27.468150 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0533c884-e895-4502-8adb-f75226846b6d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.169224 May 12 17:47:27.469312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 212/391] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:27 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:27.474111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:27.474899 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:27.489140 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:27.489601 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.490410 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:27.490841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:27.674142 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:27.687292 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-972f300d-e9a8-4749-aec5-1d54ceb68446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.217938 May 12 17:47:27.688278 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 180/392] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:27 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:28.185800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:28.186836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:28.196818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:28.197776 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:28.199525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:28.200212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:28.487418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:28.488838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:28.493764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:28.497812 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:28.498533 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:28.500750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:28.503056 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:28.507841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:28.509775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:28.514754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e644b748-340d-42d8-9b37-ab694f67a4f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.339721 May 12 17:47:28.516490 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 213/393] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:28 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:28.700299 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:28.706733 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:28.707348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:28.709226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-eb5c999a-a840-4e67-8d7e-e83824a10616 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.226880 May 12 17:47:28.709814 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 181/394] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:28 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:28.719306 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:28.719775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:28.720694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:28.724023 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:28.885826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:28.902035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7db52149-682d-4818-98c8-ef817f8cc47d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.200687 May 12 17:47:28.906496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 214/395] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:28 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:29.152892 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1419fa36-ab31-438a-b915-752813e31caf", "device": "/dev/sdb"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:29.155230 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:29.162589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:29.163321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:29.164499 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:29.165170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:29.541563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:29.543863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:29.561369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:29.562633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:29.565612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:29.566538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:29.833561 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:29.861928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:29.870465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:29.871890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-62933a0e-e286-4d69-a1f2-7e77b2aa32a9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.340500 May 12 17:47:29.899721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 215/396] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:29 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:29.920519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:29.921422 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:29.928666 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:29.929437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:29.932535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:29.933245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:30.125411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:30.151725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-da334d0f-322d-4e85-8f79-5d264525cea0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.250401 May 12 17:47:30.152876 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 216/397] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:29 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:30.159492 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:30.165486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:30.199215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:30.200501 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:30.204327 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:30.205907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:30.475541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:30.487901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2d44d037-b142-4156-8d37-8e1a4f7029fe tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1511 microversion: 2.1 time: 0.333527 May 12 17:47:30.495040 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 217/398] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:30 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:30.525497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-6d5ab22c-3387-4859-820f-3270cf3e0ba8 req-d1dde5ba-defe-463d-9537-4cff5a922dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d5ca9d-5ce9-496f-ae0c-1e2836506652", "name": "network-vif-plugged", "status": "completed", "tag": "77239c9b-45a3-42cb-94e9-552e3cd10f35"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:30.537120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6d5ab22c-3387-4859-820f-3270cf3e0ba8 req-d1dde5ba-defe-463d-9537-4cff5a922dc8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:30.545187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-6d5ab22c-3387-4859-820f-3270cf3e0ba8 req-d1dde5ba-defe-463d-9537-4cff5a922dc8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:30.562998 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-6d5ab22c-3387-4859-820f-3270cf3e0ba8 req-d1dde5ba-defe-463d-9537-4cff5a922dc8 service nova] Creating event network-vif-plugged:77239c9b-45a3-42cb-94e9-552e3cd10f35 for instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 on hv-cinder-84052 May 12 17:47:30.579866 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-6d5ab22c-3387-4859-820f-3270cf3e0ba8 req-d1dde5ba-defe-463d-9537-4cff5a922dc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051656 May 12 17:47:30.590747 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 218/399] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:47:30.699584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-334e0d53-9db6-4265-a95d-af822028d59b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "POST /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.550636 May 12 17:47:30.706475 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 182/400] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:47:29 2022] POST /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5/os-volume_attachments => generated 194 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:30.893102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:30.893817 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:30.902104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:30.902535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:30.903419 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:30.903862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:31.109764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:31.121468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:31.123780 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:31.125852 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5b261660-f7c2-4e92-97fd-94ad74798f42 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.237380 May 12 17:47:31.127289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 219/401] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:30 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:31.176696 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:31.192683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:31.203997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:31.207181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:31.208026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:31.208516 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:31.370262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:31.382261 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-737253ec-f172-430e-bd12-ae59ccbc0940 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.210811 May 12 17:47:31.383443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 183/402] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:31 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:31.512263 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:31.513242 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:31.521407 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:31.521863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:31.527090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:31.527762 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:31.702474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:31.713010 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-17219192-b0de-4300-934a-11831751ae5b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1517 microversion: 2.1 time: 0.204462 May 12 17:47:31.718314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 220/403] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:31 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1517 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:32.147242 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:32.148551 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:32.155683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.156399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.157632 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.158707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.304793 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:32.314915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:32.316555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:32.317977 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3276d8c0-d06d-40ba-a143-4169bef85482 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.176666 May 12 17:47:32.318549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 184/404] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:32 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:32.399554 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:32.400459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:32.406479 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.407097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.409494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:32.410160 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:32.545672 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:32.554417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c58a3f6c-5590-438f-83ed-7d0d8a596b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.158550 May 12 17:47:32.555133 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 221/405] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:32 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:33.242452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-532b4fee-6d79-4e50-b9b3-4996c4035312 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'create', calling method: .version_select at 0x7fc0c6202c10>, body: {"keypair": {"name": "tempest-keypair-808048432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg6mvzu6AP4konyJ98Rang0zWbAq5/Yf2Lvfw4gzUb98BJZotx706yQDU26whS5ghNuFlQ1M6RMjkCrQ3FdESDaL9Eoo7U9vYb0YpN6arWy3isnwHrSBqUO7pb09CBJFg=="}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:33.256594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-532b4fee-6d79-4e50-b9b3-4996c4035312 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for project 202db80dae2446e2b9cd1124b2925ced. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:47:33.260528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-532b4fee-6d79-4e50-b9b3-4996c4035312 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for user 298a13924a864f61adf6e4085e569358 and project 202db80dae2446e2b9cd1124b2925ced. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:47:33.282719 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-532b4fee-6d79-4e50-b9b3-4996c4035312 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044056 May 12 17:47:33.283898 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 185/406] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:47:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:47:33.336536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:33.337988 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:33.344736 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.345267 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.346865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.347375 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.522494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:33.530875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:33.532517 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:33.534525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0c222b4a-1dfe-43d7-910a-5523914a5395 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1740 microversion: 2.20 time: 0.202580 May 12 17:47:33.535233 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 222/407] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:33 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:33.571265 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:33.572071 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:33.590811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.591332 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.592272 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:33.592917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:33.798022 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:33.806325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a27993d2-f0f2-4348-a948-96722239b22e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1367 microversion: 2.1 time: 0.239292 May 12 17:47:33.807150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 186/408] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:33 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:34.552589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:34.553465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:34.559688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:34.560145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:34.560956 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:34.561399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:34.711902 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:34.720944 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:34.722477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:34.723672 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-db01647d-4007-417c-b343-b4d1ad3e6a46 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1722 microversion: 2.20 time: 0.175243 May 12 17:47:34.724511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 223/409] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:34 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:34.827763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:34.829037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:34.837760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:34.838223 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:34.839122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:34.839571 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:34.849060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1391308968", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae508b5-33ae-47fd-88cd-96de0b50f763"}], "security_groups": [{"name": "tempest-securitygroup--1130218158"}], "key_name": "tempest-keypair-808048432", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:35.018486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] validate_networks() for [('dae508b5-33ae-47fd-88cd-96de0b50f763', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:47:35.073062 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:35.080751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b842eced-e9dc-4c67-9bb8-4f2ce3a106af tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1557 microversion: 2.1 time: 0.257564 May 12 17:47:35.081331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 187/410] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:34 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1557 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:35.102105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:35.102945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:35.112248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.113346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.114648 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.115350 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.221064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8d46040d-b28b-47f8-a050-297016317408 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126030 May 12 17:47:35.222145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 188/411] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:47:35 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:47:35.481515 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:47:35.481934 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:47:35.482446 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:47:35.482854 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:47:35.483265 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:47:35.493653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.495216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.496072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.496744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.523230 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for project 202db80dae2446e2b9cd1124b2925ced. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:47:35.528647 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Getting quotas for user 298a13924a864f61adf6e4085e569358 and project 202db80dae2446e2b9cd1124b2925ced. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:47:35.547219 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:47:35.551845 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:47:35.609698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-462f769e-8c4e-4036-9176-e8d3a7ebe59e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.771766 May 12 17:47:35.611966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 224/412] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:47:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:47:35.626281 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6df42df8-3cf1-4a78-83d6-bf2ebd2857af tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:35.627746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6df42df8-3cf1-4a78-83d6-bf2ebd2857af tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:35.694182 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6df42df8-3cf1-4a78-83d6-bf2ebd2857af tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:35.701454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6df42df8-3cf1-4a78-83d6-bf2ebd2857af tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1245 microversion: 2.1 time: 0.083275 May 12 17:47:35.701904 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 189/413] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:35 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:35.743247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:35.743855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:35.750233 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.750680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.751497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:35.752821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:35.892042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:35.904078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:35.908687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:35.910446 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5b766b31-d462-4d40-b35e-8f8048e85f6c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1722 microversion: 2.20 time: 0.171248 May 12 17:47:35.912507 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 225/414] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:35 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:36.282108 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-9c8ca4a8-301c-4854-a820-ae55e7dd88ab req-8a02f078-58d3-4702-ba55-2e99bebbe79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "name": "network-vif-unplugged", "status": "completed", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:36.296363 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9c8ca4a8-301c-4854-a820-ae55e7dd88ab req-8a02f078-58d3-4702-ba55-2e99bebbe79e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.297548 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9c8ca4a8-301c-4854-a820-ae55e7dd88ab req-8a02f078-58d3-4702-ba55-2e99bebbe79e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.313762 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-9c8ca4a8-301c-4854-a820-ae55e7dd88ab req-8a02f078-58d3-4702-ba55-2e99bebbe79e service nova] Creating event network-vif-unplugged:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:47:36.321070 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-9c8ca4a8-301c-4854-a820-ae55e7dd88ab req-8a02f078-58d3-4702-ba55-2e99bebbe79e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042565 May 12 17:47:36.323852 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 190/415] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:36.600313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-85ff996f-c486-411d-87e7-41ceb47d0ff4 req-8c06fc77-4e17-42ce-a285-e837589c5e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d5ca9d-5ce9-496f-ae0c-1e2836506652", "tag": "77239c9b-45a3-42cb-94e9-552e3cd10f35"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:36.609239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-85ff996f-c486-411d-87e7-41ceb47d0ff4 req-8c06fc77-4e17-42ce-a285-e837589c5e7d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.609684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-85ff996f-c486-411d-87e7-41ceb47d0ff4 req-8c06fc77-4e17-42ce-a285-e837589c5e7d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.627994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-85ff996f-c486-411d-87e7-41ceb47d0ff4 req-8c06fc77-4e17-42ce-a285-e837589c5e7d service nova] Creating event network-changed:77239c9b-45a3-42cb-94e9-552e3cd10f35 for instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 on hv-cinder-84052 May 12 17:47:36.633370 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-85ff996f-c486-411d-87e7-41ceb47d0ff4 req-8c06fc77-4e17-42ce-a285-e837589c5e7d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036714 May 12 17:47:36.633982 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 226/416] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:36.718542 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:36.719279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:36.730036 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.730572 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.731379 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.731856 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.795249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:36.803269 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-10812317-d999-40b4-b72a-835e95d116f3 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1249 microversion: 2.1 time: 0.089010 May 12 17:47:36.803868 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 191/417] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:36 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:36.932113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:36.933606 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:36.944752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.945448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:36.946298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:36.946742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:37.081433 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:37.089080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:37.090577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:37.091724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2dc632ca-1cb1-4aef-96e9-6e2a0dd85b18 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1722 microversion: 2.20 time: 0.164988 May 12 17:47:37.092304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 227/418] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:36 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:37.820792 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:37.821969 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:37.833931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:37.834385 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:37.835176 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:37.835815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:37.910182 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:37.919041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5172c725-78ff-44f2-92c5-ae44542b90f5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1297 microversion: 2.1 time: 0.102507 May 12 17:47:37.919944 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 192/419] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:37 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:38.110405 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:38.111118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:38.117662 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.118111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.118872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.119308 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.250694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:38.260197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:38.261775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:38.262964 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d4153351-f8dc-443a-9f9a-9466a4d99bdf tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1665 microversion: 2.20 time: 0.156454 May 12 17:47:38.263527 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 228/420] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:38 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:38.283494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b36827-55bc-409c-9d25-df0224eec10c"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:38.284594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:38.290462 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.290924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.291692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.292130 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.616979 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-440d0896-6cb9-4380-b889-683715de1886 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337821 May 12 17:47:38.617583 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 193/421] 10.222.0.73 () {62 vars in 1363 bytes} [Thu May 12 17:47:38 2022] POST /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:47:38.732837 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:38.733408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:38.739774 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.740270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.741045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.741488 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.832462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3f74e80d-e172-432f-96b8-2ad2cfd02f1e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/action" status: 202 len: 0 microversion: 2.20 time: 0.103366 May 12 17:47:38.833248 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 229/422] 10.222.0.73 () {62 vars in 1318 bytes} [Thu May 12 17:47:38 2022] POST /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:47:38.841301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:38.841917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:38.850559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.851020 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.852121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.852901 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.938580 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:38.939535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:38.947586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.948276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:38.949299 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:38.949900 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:39.035588 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:39.045270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-48d32e04-df4a-4263-882e-c70c0b4d211c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1305 microversion: 2.1 time: 0.111224 May 12 17:47:39.046711 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 230/423] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:38 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:39.048002 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:39.057940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:39.059545 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:39.060752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ec14aba-ce4b-4813-9df9-b603271a34f6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1751 microversion: 2.20 time: 0.223346 May 12 17:47:39.062248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 194/424] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:38 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:40.062738 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:40.069333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.080854 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:40.082058 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:40.089615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.093178 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.093755 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.094848 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.095784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.097351 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.098229 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.100878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.321576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.333286 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ce8aa5b3-b1ef-44ee-a24b-d50dc824fe11 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.274108 May 12 17:47:40.333879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 231/425] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:40 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:40.354032 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.367398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.368956 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:40.370149 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-57f7e25e-8799-4320-b9b0-cadd470fdcfd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1751 microversion: 2.20 time: 0.293574 May 12 17:47:40.370870 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 195/426] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:40 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1751 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:40.847863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-32c7a806-f871-4eda-895b-768280530ec5 req-a267d79b-05f2-4edc-b225-e112a9d2547c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5a3c0-ae83-4249-9ac3-dddc8a328712", "tag": "bb2465e3-e5fd-4ae3-9017-cb6fa37925e6"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:40.857452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-32c7a806-f871-4eda-895b-768280530ec5 req-a267d79b-05f2-4edc-b225-e112a9d2547c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:40.857924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-32c7a806-f871-4eda-895b-768280530ec5 req-a267d79b-05f2-4edc-b225-e112a9d2547c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:40.886515 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-32c7a806-f871-4eda-895b-768280530ec5 req-a267d79b-05f2-4edc-b225-e112a9d2547c service nova] Creating event network-changed:bb2465e3-e5fd-4ae3-9017-cb6fa37925e6 for instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 on hv-cinder-84052 May 12 17:47:40.893365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-32c7a806-f871-4eda-895b-768280530ec5 req-a267d79b-05f2-4edc-b225-e112a9d2547c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051861 May 12 17:47:40.894585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 232/427] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:41.350299 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:41.350948 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:41.357285 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:41.357745 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:41.358525 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:41.358967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:41.389437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:41.390137 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:41.397403 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:41.397861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:41.398652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:41.399095 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:41.548476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:41.555831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c8614fb3-ce0c-4299-a4d6-c66e595d5fa6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.209660 May 12 17:47:41.556428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 196/428] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:41 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:41.573376 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:41.581989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:41.583502 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:41.584722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0c9cb72c-5003-4ac6-9c58-10d17c64b11c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1753 microversion: 2.20 time: 0.199478 May 12 17:47:41.585287 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 233/429] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:41 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1753 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:42.572335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:42.572960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:42.579273 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:42.580337 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.581129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:42.581577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.603808 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:42.604429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:42.610597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:42.611824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.612649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:42.613081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:42.759788 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.766995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0bcfd2a6-f553-4ac3-b5fe-d1d0ff757678 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.198492 May 12 17:47:42.767855 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 197/430] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:42 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:42.786109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.794201 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.795691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:42.796881 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d96bf3ff-f500-42bf-ab15-069bd9974f32 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1753 microversion: 2.20 time: 0.196949 May 12 17:47:42.797446 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 234/431] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:42 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:43.783460 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:43.784229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:43.790558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.791016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.791784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.792248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.816113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:43.817394 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:43.823883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.824572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.825430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:43.825941 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:43.984832 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:43.994925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9c997d06-7628-4b23-afbc-a939f53eeefb tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.214967 May 12 17:47:43.995548 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 198/432] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:43 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:44.008397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.017560 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.019087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:44.020352 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4d906590-7dd2-436d-887f-22bf6594ab7e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1753 microversion: 2.20 time: 0.209443 May 12 17:47:44.021291 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 235/433] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:43 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:45.012499 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:45.013118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:45.019975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.020518 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.021296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.021737 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.039146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:45.039860 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:45.046154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.046613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.047395 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:45.047841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:45.200106 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:45.207996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b452d312-e1f7-4a7a-a766-1aede16534bc tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.199348 May 12 17:47:45.208685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 199/434] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:45 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:45.223651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:45.231704 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:45.233240 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:45.234475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-97372004-0116-4621-9d7f-4082b9a4fd78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1753 microversion: 2.20 time: 0.199203 May 12 17:47:45.235049 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 236/435] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:45 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:46.224637 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:46.225251 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:46.231468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:46.231927 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:46.232727 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:46.233173 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:46.254803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:46.255414 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:46.261627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:46.262080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:46.262860 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:46.263299 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:46.417714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:46.425444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c295e0ef-8292-4426-bb60-b01efaad2ed2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.204526 May 12 17:47:46.426017 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 200/436] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:46 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:46.432313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:46.441321 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:46.442860 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:46.444024 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-83541467-1507-4797-8186-99294f92c23e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1753 microversion: 2.20 time: 0.194427 May 12 17:47:46.444616 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 237/437] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:46 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:47.442399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:47.443008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:47.449247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:47.449693 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:47.450458 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:47.450894 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:47.461212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:47.461763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:47.468120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:47.468612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:47.469418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:47.469856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:47.641795 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:47.648959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-06fa6d9f-099b-43d8-aab5-cda9e3cb0d00 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.210944 May 12 17:47:47.649532 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 201/438] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:47 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:47.649656 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:47.657793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:47.659384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:47.660572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-32a3befc-3724-41f6-9c49-e5baea02c224 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1753 microversion: 2.20 time: 0.203279 May 12 17:47:47.661152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 238/439] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:47 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:48.666031 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:48.666683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:48.673230 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:48.673900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.675481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:48.676500 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.680246 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:48.680855 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:48.687779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:48.688269 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.689059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:48.689503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:48.875365 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.879371 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.883128 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6a14c1d6-007d-475f-8748-df4a33e2cb3b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.220934 May 12 17:47:48.883902 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 202/440] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:48 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:48.887881 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.889408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:48.890573 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ead25fe3-5169-4ae8-9cc8-8349fb90ffd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.215587 May 12 17:47:48.891482 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 239/441] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:48 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:49.716268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-dfcf114e-8546-49ae-84c4-0389e14495fa req-8ea00797-98a4-481a-a0d0-6a9901259ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b5a3c0-ae83-4249-9ac3-dddc8a328712", "name": "network-vif-plugged", "status": "completed", "tag": "bb2465e3-e5fd-4ae3-9017-cb6fa37925e6"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:47:49.726465 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-dfcf114e-8546-49ae-84c4-0389e14495fa req-8ea00797-98a4-481a-a0d0-6a9901259ae2 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.726912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-dfcf114e-8546-49ae-84c4-0389e14495fa req-8ea00797-98a4-481a-a0d0-6a9901259ae2 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.739702 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-dfcf114e-8546-49ae-84c4-0389e14495fa req-8ea00797-98a4-481a-a0d0-6a9901259ae2 service nova] Creating event network-vif-plugged:bb2465e3-e5fd-4ae3-9017-cb6fa37925e6 for instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 on hv-cinder-84052 May 12 17:47:49.745245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-dfcf114e-8546-49ae-84c4-0389e14495fa req-8ea00797-98a4-481a-a0d0-6a9901259ae2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 May 12 17:47:49.746039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 203/442] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:47:49.901147 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:49.901715 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:49.908338 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.909661 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.910559 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.911538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.917105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:49.917960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:49.925521 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.926061 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:49.926942 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:49.927657 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:50.128596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.137337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7331757e-3087-48d8-93c7-027154349653 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.240377 May 12 17:47:50.140432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 240/443] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:49 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:50.155940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.165066 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.166573 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:50.168124 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-39031f63-6d85-4c62-be32-221c0d33a16e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.258871 May 12 17:47:50.168894 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 204/444] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:49 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:51.158602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:51.159796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:51.166061 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.166513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.167283 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.167725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.186722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:51.187334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:51.193911 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.194373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.195153 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:51.195597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:51.344388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.352198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-019eae99-54f8-4ada-a396-06519b351350 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.197483 May 12 17:47:51.352794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 241/445] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:51 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:51.366672 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.374717 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.376540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:51.377748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c509977e-39c5-4bec-bad8-62a6845eb639 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.194856 May 12 17:47:51.378387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 205/446] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:51 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:52.369315 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:52.369931 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:52.376557 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.377012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.377913 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.378354 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.395846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:52.396517 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:52.402750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.403208 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.403985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:52.404455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:52.806564 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:52.809674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:52.814871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:52.816631 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:52.816831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3a6a6840-99ab-47c7-a42f-6e57863beaf9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.451337 May 12 17:47:52.817402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 242/447] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:52 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:52.817794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1eb2ea3f-7e13-497b-a025-fa4e046a46d0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.425805 May 12 17:47:52.818500 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 206/448] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:52 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:53.835304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:53.836123 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:53.836627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:53.836766 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:53.843213 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:53.843666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:53.843932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:53.844578 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:53.845014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:53.845668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:53.847388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:53.848085 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:54.045488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.056907 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.058498 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.060771 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0ccfd8ee-966f-437b-9dad-ba788adc9aed tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.228526 May 12 17:47:54.061369 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 207/449] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:53 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:47:54.062415 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:54.070675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e200ca5a-9985-4b36-9062-43fcea4cb684 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.240780 May 12 17:47:54.071241 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 243/450] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:53 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:55.078984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:55.079658 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:55.086209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:55.086655 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.087427 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:55.087863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.087973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:55.088706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:55.095155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:55.095938 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.097434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:55.098122 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:55.303777 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.314168 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.317461 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.318026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:55.319686 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0924f1fe-f0a5-4882-81ea-a6bdf259a644 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.244621 May 12 17:47:55.321043 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 208/451] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:55 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:55.326026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9f769fe2-1d8d-4c1a-b46e-9ec5cb51b649 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.242377 May 12 17:47:55.326612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 244/452] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:55 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:56.338435 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:56.339385 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:56.342392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:56.343012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:56.345546 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.346001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.346835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.347263 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.350152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.350864 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.351710 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:56.352339 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:56.558744 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.565285 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.567244 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.568810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:56.570078 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5042565b-df6d-4a8a-855a-603dbd987e26 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.235509 May 12 17:47:56.570718 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 209/453] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:56 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:56.573366 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b3f8e304-af9c-45ad-bb32-338b2712919c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.234583 May 12 17:47:56.584272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 245/454] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:56 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:57.589787 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:57.590359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:57.590774 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:57.590962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:57.597494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.598331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.598450 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.599055 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.599547 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.602600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.603477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:57.603921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:57.820742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.831823 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-150e2aed-0096-4db3-848c-ae3d1df29187 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.245071 May 12 17:47:57.832660 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 246/455] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:57 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:47:57.866055 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.876699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.878854 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:57.880552 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b86e35de-9d38-4c48-b07f-3820a018aeac tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.294706 May 12 17:47:57.881794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 210/456] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:57 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:47:58.848404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:58.849060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:58.855591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.856066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.856887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.857509 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.899333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:47:58.899961 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:47:58.906882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.907338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:58.908705 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:47:58.911038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:47:59.110538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:59.118945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7ee5104d-c901-43dd-a651-ed72f99539c0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.274670 May 12 17:47:59.129951 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 247/457] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:47:58 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:47:59.134605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:59.144217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:59.146000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:47:59.147179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-11e361b3-d6e5-4768-a8fe-6e63ce5818de tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.251681 May 12 17:47:59.147902 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 211/458] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:47:58 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:48:00.064402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:00.064981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:00.086116 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.086580 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.088554 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.090145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.137278 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:00.138896 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:00.150341 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.151148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.152418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.153084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.269287 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lazy-loading 'services' on Instance uuid fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:00.368570 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.377257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-25fbce92-79af-4fcc-83d7-e8063c9e9112 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.244283 May 12 17:48:00.378708 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 212/459] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:00 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:00.383416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:00.384044 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:00.398191 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.398775 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.399620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:00.400356 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:00.473799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-013cefc9-8546-43f6-b0bd-118eb40c9db2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5/os-volume_attachments/1419fa36-ab31-438a-b915-752813e31caf" status: 202 len: 0 microversion: 2.1 time: 0.413184 May 12 17:48:00.474580 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 248/460] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:48:00 2022] DELETE /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5/os-volume_attachments/1419fa36-ab31-438a-b915-752813e31caf => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:48:00.579440 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.588128 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.589641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:00.590795 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8ada615e-2399-4753-8177-d5ec21758046 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.211266 May 12 17:48:00.591351 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 213/461] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:00 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:01.401278 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:01.405302 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:01.412536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.413068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.413941 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.414456 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.562388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:01.571203 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dbf62d4d-2360-4cd4-a8a3-2f0a1692411d tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.174165 May 12 17:48:01.571790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 249/462] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:01 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:01.610110 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:01.610728 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:01.618605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.619931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.620811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:01.621335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:01.795175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:01.811998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:01.817501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:01.818810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d9da97e9-ea53-48e1-9cbd-fb98b9f9afba tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.212715 May 12 17:48:01.821980 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 214/463] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:01 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:02.591398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:02.591960 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:02.600019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:02.600929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.601262 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:02.601701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.740892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:02.748308 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b6f06d3a-6d50-4fe1-9497-177cc9bca7ac tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.160855 May 12 17:48:02.748929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 250/464] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:02 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:02.841022 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:02.841888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:02.849167 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:02.849623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.850407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:02.850847 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:02.995183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:03.004806 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:03.006787 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:03.008009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1b5179be-b7e2-432e-982c-a6370fa7fb19 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.170817 May 12 17:48:03.015183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 215/465] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:02 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:03.766088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:03.766724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:03.773057 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.773503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.774263 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:03.774694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:03.905066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:03.914320 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ed475fe7-2869-46fb-bf33-cc3ca8bd2c38 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.151968 May 12 17:48:03.915051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 251/466] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:03 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:04.027293 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:04.027828 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:04.034928 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:04.035384 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:04.036236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:04.036742 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:04.163006 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:04.171216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:04.172759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:04.173924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-78298d20-d7b1-45d8-8cf6-a015b7791182 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.150600 May 12 17:48:04.175594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 216/467] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:04 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:04.930601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:04.931234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:04.937477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:04.937921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:04.938709 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:04.939141 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:05.067265 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:05.074397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-61006e2b-2eb9-4d10-a51c-7b6a694a841f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.147558 May 12 17:48:05.074968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 252/468] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:04 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:05.194152 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:05.194897 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:05.201212 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:05.201671 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:05.202443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:05.202887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:05.329312 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:05.338579 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:05.340132 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:05.341341 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f0b5f66e-4578-4211-9b65-9040c3f38160 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.151962 May 12 17:48:05.342067 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 217/469] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:05 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:06.093963 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:06.094503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:06.101894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.102350 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.103131 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.103583 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.234856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:06.242012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1e73c9ba-6ab8-4843-a02e-9131f51c7767 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1371 microversion: 2.1 time: 0.154170 May 12 17:48:06.242578 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 253/470] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:06 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:06.360262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:06.360810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:06.367937 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.368425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.369208 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:06.369650 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:06.500056 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:06.509176 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:06.510676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:06.511833 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bd49f557-c4dd-4fda-b78d-993c84ce7fe1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.155514 May 12 17:48:06.512440 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 218/471] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:06 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:07.258742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:07.259257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:07.265419 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.265864 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.266625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.267054 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.392295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:07.399583 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e3f3724b-fe65-4c87-95d6-73f777272ca1 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1565 microversion: 2.1 time: 0.144722 May 12 17:48:07.400150 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 254/472] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:07 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1565 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:07.416964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:07.417479 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:07.423697 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.424177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.426226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.426670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.509095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b4675b53-277e-4608-9c2d-7d79b9e86e13 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096534 May 12 17:48:07.509636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 219/473] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:48:07 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:07.530931 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:07.531772 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:07.538538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.538990 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.539957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:07.540615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:07.791628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:07.799959 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:07.801508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:07.802739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e9d98126-c135-4c05-aebe-5a5a6e298b6e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.275623 May 12 17:48:07.803296 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 255/474] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:07 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:48:08.585792 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-4d598fbf-7d5a-47c4-abbc-d808b7a51396 req-55d2a66f-3f6f-4588-a0f2-c84456b68256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5a3c0-ae83-4249-9ac3-dddc8a328712", "tag": "bb2465e3-e5fd-4ae3-9017-cb6fa37925e6"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:08.602103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-4d598fbf-7d5a-47c4-abbc-d808b7a51396 req-55d2a66f-3f6f-4588-a0f2-c84456b68256 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.602816 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-4d598fbf-7d5a-47c4-abbc-d808b7a51396 req-55d2a66f-3f6f-4588-a0f2-c84456b68256 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.615047 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-4d598fbf-7d5a-47c4-abbc-d808b7a51396 req-55d2a66f-3f6f-4588-a0f2-c84456b68256 service nova] Creating event network-changed:bb2465e3-e5fd-4ae3-9017-cb6fa37925e6 for instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 on hv-cinder-84052 May 12 17:48:08.621345 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-4d598fbf-7d5a-47c4-abbc-d808b7a51396 req-55d2a66f-3f6f-4588-a0f2-c84456b68256 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039566 May 12 17:48:08.622127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 220/475] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:08.821077 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:08.821684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:08.828136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.828610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.829389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.829992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.977563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:08.987477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:08.988036 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:08.988824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:08.989659 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:08.990945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d49ab489-20ca-42c5-b3e8-9c5db5cc4a35 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.173877 May 12 17:48:08.991801 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 256/476] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:08 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:08.994858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.995306 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:08.996075 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:08.996698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:09.023240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:09.124141 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d20d85b0-2f70-43bb-9693-1da41af81719 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 204 len: 0 microversion: 2.1 time: 0.140290 May 12 17:48:09.125695 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 221/477] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:48:08 2022] DELETE /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:48:09.142637 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:09.144337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:09.169885 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:09.173656 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:09.177615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:09.180318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:09.371175 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:09.379031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fd1cbe4f-f85f-4a45-b66f-42919a9cecc2 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1513 microversion: 2.1 time: 0.246991 May 12 17:48:09.380183 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 257/478] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:09 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:10.009823 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:10.010530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:10.016789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.017247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.018595 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.019041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.146816 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:10.154971 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:10.156512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:10.157667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-778aff10-acc4-4c07-b799-10d848a11a67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.152148 May 12 17:48:10.158228 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 222/479] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:10 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:10.396869 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:10.397400 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:10.403766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.404254 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.405022 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:10.405459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:10.535237 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:10.542852 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-853de7b6-7f21-4ab2-853c-ef57d0b33dd5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1513 microversion: 2.1 time: 0.150124 May 12 17:48:10.543419 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 258/480] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:10 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:11.176610 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:11.177253 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:11.183738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.184369 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.185154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.185605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.320103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:11.328348 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:11.329863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:11.331815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d3e3ba91-23fd-4a03-9ecd-8c00f298b89e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.159652 May 12 17:48:11.332739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 223/481] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:11 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:11.560290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:11.560900 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:11.567848 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.568378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.569119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:11.569550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:11.718959 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:11.727150 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5bc86da1-a42d-42d0-8de9-6d69d26113fb tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1513 microversion: 2.1 time: 0.170614 May 12 17:48:11.727739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 259/482] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:11 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:12.295401 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-75049a08-0aa0-4631-9c49-7a58bbddd9be req-5928706d-62c5-4079-8084-3959de43b396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5fc433-fe1c-47fa-b31c-fea85a6c25a5", "name": "network-vif-deleted", "tag": "90a3053b-ee33-4c0a-a3ac-73e9c7651517"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:12.304289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-75049a08-0aa0-4631-9c49-7a58bbddd9be req-5928706d-62c5-4079-8084-3959de43b396 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.304964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-75049a08-0aa0-4631-9c49-7a58bbddd9be req-5928706d-62c5-4079-8084-3959de43b396 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.331264 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-75049a08-0aa0-4631-9c49-7a58bbddd9be req-5928706d-62c5-4079-8084-3959de43b396 service nova] Creating event network-vif-deleted:90a3053b-ee33-4c0a-a3ac-73e9c7651517 for instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 on hv-cinder-84052 May 12 17:48:12.352631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:12.352631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:12.360794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.361205 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.363093 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-75049a08-0aa0-4631-9c49-7a58bbddd9be req-5928706d-62c5-4079-8084-3959de43b396 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071267 May 12 17:48:12.364075 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.364692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.369443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 224/483] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:12.567826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:12.577622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:12.579127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:12.580387 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-846b0d1f-27cb-4308-b44e-183767f8ae09 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.234064 May 12 17:48:12.582493 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 260/484] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:12 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:12.745406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:12.746107 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:12.752387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.752855 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.753624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.754061 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.786105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:12.786560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:12.787010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lazy-loading 'fault' on Instance uuid fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:12.828722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:12.835985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-07ce6ac8-707a-49f7-8f6b-ab4b1dbd089d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 200 len: 1308 microversion: 2.1 time: 0.094665 May 12 17:48:12.836589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 225/485] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:12 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:13.599092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:13.599702 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:13.605955 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.606407 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.607171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.607605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.741907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:13.750110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:13.751870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:13.753169 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4d75c3c5-38f4-41a3-b967-9dbce018a5a5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.158457 May 12 17:48:13.753730 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 261/486] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:13 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:13.852878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:13.853420 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: fa5fc433-fe1c-47fa-b31c-fea85a6c25a5] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:13.859762 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.860261 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.861065 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:13.861690 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:13.874970 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] HTTP exception thrown: Instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 could not be found. May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Request method failure captured: May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 HTTP/1.1 May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUf4vVSZfDhvnLnJ2FY0st57LsBoVOvbAmNndJvQaTANYy-cZlCCDOVbh_7USMLntq4Ufr1CmSFqLW4YC4-Tty0v9bjerlB9H-wsbuJ_Q93OPrtY8Yw_LVgIgAFd-VlaTXqT2BPj0GoXfxdc9Elqgj-Ze2XyLa2TusZaa4rr_Oi7fMM May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 7ef859014e4d4ff79fb7958511f20d11 May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1083133363 May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:48:13.876864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7ef859014e4d4ff79fb7958511f20d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7ef859014e4d4ff79fb7958511f20d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7ef859014e4d4ff79fb7958511f20d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7ef859014e4d4ff79fb7958511f20d11", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-VolumesSnapshotTestJSON-1083133363 May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 7ef859014e4d4ff79fb7958511f20d11 May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1083133363 May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-VolumesSnapshotTestJSON-1083133363-project May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 5ad6490c8b8249b1b2abcb0f359330df May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-VolumesSnapshotTestJSON-1083133363-project May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 could not be found. May 12 17:48:13.878522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'fa5fc433-fe1c-47fa-b31c-fea85a6c25a5'} May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 could not be found. May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:13.879617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 could not be found. May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 could not be found. May 12 17:48:13.881085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:13.882382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Returning 404 to user: Instance fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:13.882382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dce0481a-c94e-4d90-b068-7622b7038bee tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5" status: 404 len: 111 microversion: 2.1 time: 0.029305 May 12 17:48:13.882382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 226/487] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:13 2022] GET /compute/v2.1/servers/fa5fc433-fe1c-47fa-b31c-fea85a6c25a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:48:14.771302 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:14.771911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:14.778184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:14.778641 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:14.779410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:14.779847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:14.905324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:14.914476 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:14.915966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:14.917234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b3c7288b-2a1e-48d2-80f9-4fdfe920eba3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.149853 May 12 17:48:14.917802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 262/488] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:14 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:15.935835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:15.936466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:15.943489 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:15.943935 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:15.944746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:15.945233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:16.076918 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:16.085406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:16.086906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:16.088132 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-37e6ca28-7085-4676-980f-cd093f04b122 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.156106 May 12 17:48:16.088710 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 227/489] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:15 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:17.105679 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:17.106322 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:17.113050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:17.113572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:17.114319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:17.114924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:17.257002 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:17.266178 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:17.267679 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:17.270150 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-57d1a8ee-dc31-446d-a9b4-2039f0638d83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.168317 May 12 17:48:17.270775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 263/490] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:17 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:18.289183 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:18.289875 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:18.296214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:18.296736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:18.297574 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:18.298075 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:18.460503 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:18.469827 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:18.472559 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:18.473755 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4ae7d7d9-9f1f-4fae-9ec2-cb62dbe7a715 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.188604 May 12 17:48:18.474310 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 228/491] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:18 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:19.492604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:19.493249 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:19.499801 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:19.500280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:19.501312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:19.501752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:19.629211 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:19.637501 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:19.639033 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:19.640314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-39703691-c470-428c-9dd5-9281f2ee02be tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.151640 May 12 17:48:19.640886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 264/492] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:19 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:20.576251 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-90247a38-adea-4d19-9a61-d46a280bc3f9 req-68dca0bd-62e7-4cbd-b3be-de43e5611a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:20.585683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-90247a38-adea-4d19-9a61-d46a280bc3f9 req-68dca0bd-62e7-4cbd-b3be-de43e5611a91 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.586135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-90247a38-adea-4d19-9a61-d46a280bc3f9 req-68dca0bd-62e7-4cbd-b3be-de43e5611a91 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.598331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-90247a38-adea-4d19-9a61-d46a280bc3f9 req-68dca0bd-62e7-4cbd-b3be-de43e5611a91 service nova] Creating event network-vif-plugged:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:48:20.605823 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-90247a38-adea-4d19-9a61-d46a280bc3f9 req-68dca0bd-62e7-4cbd-b3be-de43e5611a91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033140 May 12 17:48:20.606468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 229/493] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:20.658740 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:20.659593 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:20.666241 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.666689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.667462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:20.667923 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:20.795812 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:20.804665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:20.806151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:20.807297 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-20bae57a-cc0d-4fbe-86fc-75ed0ecf859c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.152452 May 12 17:48:20.807865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 265/494] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:20 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:21.719141 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-613640688", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "networks": [{"uuid": "27ef8398-cbd5-4979-a9fc-e97a3c65d254"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:21.770658 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] validate_networks() for [('27ef8398-cbd5-4979-a9fc-e97a3c65d254', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:48:21.828298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:21.829503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:21.836568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:21.837090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:21.837877 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:21.838319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.063404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:22.072882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:22.074436 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:22.075604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0d9c2598-b20e-4029-9f03-7ff835003d71 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.253098 May 12 17:48:22.076187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 266/495] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:21 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:22.169381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:48:22.169809 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:48:22.170289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:48:22.170702 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:48:22.171120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:48:22.180187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:22.180776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.181586 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:22.182031 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:22.198531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Getting quotas for project 7ef859014e4d4ff79fb7958511f20d11. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:22.202540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Getting quotas for user 5ad6490c8b8249b1b2abcb0f359330df and project 7ef859014e4d4ff79fb7958511f20d11. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:22.213915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:48:22.216248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:48:22.264245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3d4a7040-c4dc-45c9-885a-d68eb0baaa8b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549770 May 12 17:48:22.264898 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 230/496] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:48:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:48:22.275396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f34909a6-7355-4806-aced-0452a8c4544e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:22.276016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f34909a6-7355-4806-aced-0452a8c4544e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:22.330369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f34909a6-7355-4806-aced-0452a8c4544e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:22.337091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f34909a6-7355-4806-aced-0452a8c4544e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1218 microversion: 2.1 time: 0.065445 May 12 17:48:22.337756 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 267/497] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:22 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:23.093767 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:23.094385 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:23.102990 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.103451 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.104274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.104721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.240363 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:23.248530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:23.250029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:23.251441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2fd4bb05-7b7e-425d-abc2-7c73cda56cf2 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1809 microversion: 2.20 time: 0.161627 May 12 17:48:23.251994 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 231/498] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:23 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:23.354364 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:23.354975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:23.361567 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.362016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.362778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:23.363213 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:23.424545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:23.431832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-04f7eea2-eb60-405b-9a0b-7e1f846a6936 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1270 microversion: 2.1 time: 0.081583 May 12 17:48:23.432437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 268/499] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:23 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:24.269627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:24.270257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:24.277340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.277793 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.278788 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.279229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.413330 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:24.422601 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:24.424139 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:24.425939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e192dc37-04fe-4f09-907d-d04dda4ba2c8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1796 microversion: 2.20 time: 0.160311 May 12 17:48:24.426665 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 232/500] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:48:24 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1796 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:48:24.448947 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:24.449613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:24.455771 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.456290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.457127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:24.457561 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:24.519968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:24.527466 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-44568efd-ee15-4cb0-8e2d-a49ef483e783 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1276 microversion: 2.1 time: 0.082604 May 12 17:48:24.528050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 269/501] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:24 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:25.495724 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-02c5d7aa-6db4-46d4-956c-e446bfc932cc req-207c2f78-100f-4706-9d16-90fc4949c39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d36b24d-a1c7-4a2a-9ba1-f19c815aa441", "tag": "02ed1688-bc56-4512-920a-ee5a4af2eed2"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:25.506341 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-02c5d7aa-6db4-46d4-956c-e446bfc932cc req-207c2f78-100f-4706-9d16-90fc4949c39c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:25.507229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-02c5d7aa-6db4-46d4-956c-e446bfc932cc req-207c2f78-100f-4706-9d16-90fc4949c39c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:25.522163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-02c5d7aa-6db4-46d4-956c-e446bfc932cc req-207c2f78-100f-4706-9d16-90fc4949c39c service nova] Creating event network-changed:02ed1688-bc56-4512-920a-ee5a4af2eed2 for instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 on hv-cinder-84052 May 12 17:48:25.527028 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-02c5d7aa-6db4-46d4-956c-e446bfc932cc req-207c2f78-100f-4706-9d16-90fc4949c39c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035006 May 12 17:48:25.527618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 233/502] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:25.544775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:25.545511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:25.552223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:25.552664 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:25.553441 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:25.553879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:25.681928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:25.689120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c71615f4-02ae-496b-9760-d50495c170cc tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.148190 May 12 17:48:25.689640 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 270/503] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:25 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:26.708433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:26.709126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:26.715170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:26.715623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:26.716443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:26.716879 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:26.845340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:26.852755 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-75c1a28e-1ffb-49a3-9e85-b34afe6438d9 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.149842 May 12 17:48:26.853320 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 234/504] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:26 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:27.869302 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:27.869936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:27.876568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.877024 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:27.877802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:27.878385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:28.003459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:28.010599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-09dc93e4-0dd4-4168-b756-94295c04289e tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.145179 May 12 17:48:28.011169 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 271/505] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:27 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:29.026738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:29.027354 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:29.033671 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.034130 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:29.035188 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:29.035633 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:29.159760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:29.167061 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-39196181-0bc0-4cf6-9153-a8af6600068b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.144202 May 12 17:48:29.167624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 235/506] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:29 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:30.183180 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:30.183785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:30.189781 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.190223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.191123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:30.191705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:30.325088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:30.332903 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f7dcf811-8ba2-4d2e-ba9c-e751b09c907b tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.153526 May 12 17:48:30.333473 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 272/507] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:30 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:31.350325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:31.350939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:31.357316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.357769 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.358540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.358982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.483866 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:31.491867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bef185fa-4f72-4093-9509-236f7968109d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.146242 May 12 17:48:31.492471 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 236/508] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:31 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:31.714081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:31.714578 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:31.721446 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.723562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.724389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.724824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.748468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4a5aad2b-eafc-493f-95ae-5de6898508d5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/ips" status: 200 len: 150 microversion: 2.1 time: 0.038234 May 12 17:48:31.754593 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 273/509] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:48:31 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:31.760030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dada5f22-9ecf-46b6-8341-e763ae5f2b39"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:31.761186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:31.766904 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.767357 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.768127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.768592 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.824716 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-8b54bbf0-db28-4359-b457-2f08b9125f2e req-59086a24-a8cf-4e04-9024-797a052b88cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d36b24d-a1c7-4a2a-9ba1-f19c815aa441", "name": "network-vif-plugged", "status": "completed", "tag": "02ed1688-bc56-4512-920a-ee5a4af2eed2"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:31.836509 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-8b54bbf0-db28-4359-b457-2f08b9125f2e req-59086a24-a8cf-4e04-9024-797a052b88cf service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.836929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-8b54bbf0-db28-4359-b457-2f08b9125f2e req-59086a24-a8cf-4e04-9024-797a052b88cf service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.848999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Invalid volume: volume dada5f22-9ecf-46b6-8341-e763ae5f2b39 is already attached to instances: 959c1a20-6a14-4d41-a7a4-f7eded2fc759 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: POST /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/os-volume_attachments HTTP/1.1 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 74 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:48:31.850804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {"volumeAttachment": {"volumeId": "dada5f22-9ecf-46b6-8341-e763ae5f2b39"}} May 12 17:48:31.852268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Invalid volume: volume dada5f22-9ecf-46b6-8341-e763ae5f2b39 is already attached to instances: 959c1a20-6a14-4d41-a7a4-f7eded2fc759 May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'server_id': 'a7d5ca9d-5ce9-496f-ae0c-1e2836506652', 'body': {'volumeAttachment': {'volumeId': 'dada5f22-9ecf-46b6-8341-e763ae5f2b39'}}} May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dada5f22-9ecf-46b6-8341-e763ae5f2b39 is already attached to instances: 959c1a20-6a14-4d41-a7a4-f7eded2fc759 May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:31.856720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dada5f22-9ecf-46b6-8341-e763ae5f2b39 is already attached to instances: 959c1a20-6a14-4d41-a7a4-f7eded2fc759 May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:31.858156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dada5f22-9ecf-46b6-8341-e763ae5f2b39 is already attached to instances: 959c1a20-6a14-4d41-a7a4-f7eded2fc759 May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 400 to user: Invalid volume: volume dada5f22-9ecf-46b6-8341-e763ae5f2b39 is already attached to instances: 959c1a20-6a14-4d41-a7a4-f7eded2fc759 {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4a4eba13-53ba-43f3-a812-517307d74823 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096635 May 12 17:48:31.859469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 237/510] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:48:31 2022] POST /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:48:31.860087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-8b54bbf0-db28-4359-b457-2f08b9125f2e req-59086a24-a8cf-4e04-9024-797a052b88cf service nova] Creating event network-vif-plugged:02ed1688-bc56-4512-920a-ee5a4af2eed2 for instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 on hv-cinder-84052 May 12 17:48:31.861428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:31.861923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:31.862773 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-8b54bbf0-db28-4359-b457-2f08b9125f2e req-59086a24-a8cf-4e04-9024-797a052b88cf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041633 May 12 17:48:31.863525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 274/511] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:31.870282 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.870939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.872416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:31.873085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:31.902318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:31.982247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fef9bde7-a415-4d65-8faf-ad7e174a84db tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 204 len: 0 microversion: 2.1 time: 0.124317 May 12 17:48:31.983219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 238/512] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:48:31 2022] DELETE /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:31.993373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:31.994073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:32.000296 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.001010 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.001786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.002228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.133275 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:32.140416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f85ea838-4ece-4085-a9d0-5bae5810937a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1682 microversion: 2.1 time: 0.152356 May 12 17:48:32.140980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 275/513] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:31 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:32.509596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:32.510283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:32.517531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.517986 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.519356 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:32.519829 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:32.648326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:32.655480 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-73be4150-1c8c-4444-a5c2-ce04e5a3f09c tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.150249 May 12 17:48:32.656049 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 239/514] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:32 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:33.157716 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:33.158307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:33.164893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.165462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.166274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.166758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.298337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:33.306462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-586cfabb-f7ac-4c52-bcb7-0995a4cc1d8a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1682 microversion: 2.1 time: 0.152571 May 12 17:48:33.307042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 276/515] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:33 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:33.672612 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:33.673224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:33.680100 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.680577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.681343 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:33.681780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:33.805717 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:33.812960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a24e8573-9065-4075-bd39-fe04e0d06640 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1318 microversion: 2.1 time: 0.144172 May 12 17:48:33.813526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 240/516] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:33 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:34.330174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:34.330789 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:34.337802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.338255 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.339025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.339466 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.386276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:48:34.386491 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Thu May 12 17:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 (ip 10.222.0.73) !!! May 12 17:48:34.466053 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:34.473402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-87d32ab7-a3d5-4d46-a404-06430ba8d4a1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1682 microversion: 2.1 time: 0.147087 May 12 17:48:34.473981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 277/517] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:34 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:34.830767 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:34.832385 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:34.838778 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.839313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.840203 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:34.840639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:34.973506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:34.980781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b536d3c4-09b0-4373-b858-52e9de33fce7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1507 microversion: 2.1 time: 0.154576 May 12 17:48:34.981352 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 241/518] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:34 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:34.997896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbaf59b1-d900-410a-a44e-14780c6df11a", "device": "/dev/sdb"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:34.999516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:35.009784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.010234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.011355 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.011788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.386803 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-90a5ec9f-fad4-4d6d-936f-a1fa8163fb9a req-e1a288af-e28e-4bde-8a3b-257b15f56fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d5ca9d-5ce9-496f-ae0c-1e2836506652", "name": "network-vif-deleted", "tag": "77239c9b-45a3-42cb-94e9-552e3cd10f35"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:35.400542 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-90a5ec9f-fad4-4d6d-936f-a1fa8163fb9a req-e1a288af-e28e-4bde-8a3b-257b15f56fd2 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.401142 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-90a5ec9f-fad4-4d6d-936f-a1fa8163fb9a req-e1a288af-e28e-4bde-8a3b-257b15f56fd2 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.415437 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-90a5ec9f-fad4-4d6d-936f-a1fa8163fb9a req-e1a288af-e28e-4bde-8a3b-257b15f56fd2 service nova] Creating event network-vif-deleted:77239c9b-45a3-42cb-94e9-552e3cd10f35 for instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 on hv-cinder-84052 May 12 17:48:35.421964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-90a5ec9f-fad4-4d6d-936f-a1fa8163fb9a req-e1a288af-e28e-4bde-8a3b-257b15f56fd2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 May 12 17:48:35.427654 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 242/519] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:35.491604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:35.494970 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:35.510419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.513382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.517748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.518224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.570707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:35.571162 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:35.571623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lazy-loading 'fault' on Instance uuid a7d5ca9d-5ce9-496f-ae0c-1e2836506652 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:35.595394 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-58de9767-ea52-4fbd-a8ef-fb27166393a5 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "POST /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601179 May 12 17:48:35.597084 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 278/520] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:48:34 2022] POST /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:35.635746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:35.643546 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-62b25357-9bf7-4590-8c42-2a418d8289b5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 200 len: 1331 microversion: 2.1 time: 0.157384 May 12 17:48:35.648610 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 243/521] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:35 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:36.661856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:36.663181 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:36.675293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:36.676790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:36.677764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:36.678362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:36.695565 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 HTTP/1.1 May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:48:36.697261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:48:36.698518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'a7d5ca9d-5ce9-496f-ae0c-1e2836506652'} May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:36.699260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:48:36.700430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:36.701537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:36.701537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d57239c9-62bb-4fd6-b052-e75ed3641360 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 404 len: 111 microversion: 2.1 time: 0.041908 May 12 17:48:36.701537 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 279/522] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:36 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:48:36.717321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bb05a006-32ac-4721-b1ae-cc7a5535df00 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '.version_select at 0x7fc0c61c3550>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:36.750564 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bb05a006-32ac-4721-b1ae-cc7a5535df00 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544020638" status: 202 len: 0 microversion: 2.1 time: 0.042784 May 12 17:48:36.751443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 244/523] 10.222.0.73 () {58 vars in 1220 bytes} [Thu May 12 17:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544020638 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:48:37.414047 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:37.414541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:37.420861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:37.421313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:37.422073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:37.422512 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:37.502150 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lazy-loading 'services' on Instance uuid 959c1a20-6a14-4d41-a7a4-f7eded2fc759 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:37.572680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-36da2e45-8139-44d9-8033-0cb7f991705c tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments/dada5f22-9ecf-46b6-8341-e763ae5f2b39" status: 202 len: 0 microversion: 2.1 time: 0.163082 May 12 17:48:37.573256 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 280/524] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:48:37 2022] DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments/dada5f22-9ecf-46b6-8341-e763ae5f2b39 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:48:37.585211 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:37.586294 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:37.594059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:37.594706 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:37.595494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:37.595934 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:37.627798 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-82e7ae02-6938-481c-8d2f-b7155cc5fa09 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050109 May 12 17:48:37.628494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 245/525] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:37 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:38.640068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:38.641159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:38.647684 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:38.648134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:38.648936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:38.649373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:38.679026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-738f63bd-c535-4e89-94fd-4015862e7ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 May 12 17:48:38.679585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 281/526] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:38 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:39.691606 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:39.692577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:39.699315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:39.699765 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:39.700580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:39.701025 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:39.730364 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0ec246d0-b887-42de-a622-f64b6356d820 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 May 12 17:48:39.730933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 246/527] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:39 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:40.740970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:40.741897 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:40.748301 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:40.748740 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:40.749514 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:40.749949 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:40.778635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2de540a3-8bda-4e09-a0dd-63f7c386d3bf tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041675 May 12 17:48:40.779186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 282/528] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:40 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:41.790293 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:41.791144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:41.797441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:41.797899 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:41.798676 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:41.799122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:41.828243 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-68b1de59-5440-4693-a67f-330ff98383b3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041966 May 12 17:48:41.828802 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 247/529] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:41 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:42.839651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:42.840601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:42.846831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:42.847407 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:42.848026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:42.848489 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:42.876779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fb94de37-9f8e-4b27-91e7-84b92fc79c7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040960 May 12 17:48:42.877256 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 283/530] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:42 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:43.888457 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:43.889314 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:43.896082 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:43.896568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:43.897335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:43.897781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:43.928425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-24ce2d70-5373-4438-910c-de218156962e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 May 12 17:48:43.928974 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 248/531] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:43 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:44.940198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:44.941411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:44.947693 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:44.948349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:44.949125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:44.949567 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:44.978232 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-28695f9d-0530-4851-ba8a-de4b517e8fd1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 May 12 17:48:44.978785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 284/532] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:44 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:45.990645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:45.991576 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:45.997943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.998402 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:45.999175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:45.999617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:46.029250 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-94191370-4cbb-4e77-baa8-2d5f48c9956d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 May 12 17:48:46.029810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 249/533] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:45 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:47.040896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:47.041827 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:47.048117 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.048600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.049368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.049809 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.079313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-07ce4866-ccfd-4142-9cbd-deb13cb45d73 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042382 May 12 17:48:47.079875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 285/534] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:48:47 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:48:47.136456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:47.136962 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:47.143224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.144882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.145667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.146118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.170435 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:47.242527 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6da97180-ad1a-463a-9586-8d89954b772d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 204 len: 0 microversion: 2.1 time: 0.109564 May 12 17:48:47.243197 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 250/535] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:48:47 2022] DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:48:47.251626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:47.252280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:47.258794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.259244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.260011 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:47.260486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:47.393623 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:47.401444 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-878085f4-4453-4c90-b05b-b36b7d386eac tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1681 microversion: 2.1 time: 0.153865 May 12 17:48:47.402030 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 286/536] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:47 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:48.419597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:48.420328 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:48.426645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.427096 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.427866 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:48.428342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:48.554402 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:48.561708 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9f3fff19-583e-4334-a5c6-75738d295914 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1681 microversion: 2.1 time: 0.146534 May 12 17:48:48.562274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 251/537] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:48 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:49.579097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:49.579708 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:49.586894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.587349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.588130 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:49.588592 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:49.718249 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:49.725546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e09ba71d-fe82-4caf-a4b1-bdd0933ba4da tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1681 microversion: 2.1 time: 0.150211 May 12 17:48:49.726111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 287/538] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:49 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:50.742439 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:50.743100 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:50.749247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:50.749694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:50.750456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:50.751145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:50.876349 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:50.884142 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-50e9884f-29bc-449f-93e5-0abda1eaac71 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1681 microversion: 2.1 time: 0.145559 May 12 17:48:50.884752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 252/539] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:50 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:51.902065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:51.902679 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:51.909753 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:51.910336 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:51.911156 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:51.911786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:51.977529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:51.985738 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f0e1f3b5-239b-45b7-ad01-7c11de284ef6 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 200 len: 1613 microversion: 2.1 time: 0.087477 May 12 17:48:51.986319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 288/540] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:51 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:52.228583 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-4ddb9f0a-01a5-449f-9cfe-3b236b33db36 req-8ad1727b-2114-4487-aab8-e27d3077aa30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959c1a20-6a14-4d41-a7a4-f7eded2fc759", "name": "network-vif-deleted", "tag": "696c3de0-2f65-443b-a6cb-798a7dddbb0b"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:52.239403 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-4ddb9f0a-01a5-449f-9cfe-3b236b33db36 req-8ad1727b-2114-4487-aab8-e27d3077aa30 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:52.239851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-4ddb9f0a-01a5-449f-9cfe-3b236b33db36 req-8ad1727b-2114-4487-aab8-e27d3077aa30 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:52.251541 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-4ddb9f0a-01a5-449f-9cfe-3b236b33db36 req-8ad1727b-2114-4487-aab8-e27d3077aa30 service nova] Creating event network-vif-deleted:696c3de0-2f65-443b-a6cb-798a7dddbb0b for instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 on hv-cinder-84052 May 12 17:48:52.257276 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-4ddb9f0a-01a5-449f-9cfe-3b236b33db36 req-8ad1727b-2114-4487-aab8-e27d3077aa30 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032527 May 12 17:48:52.258575 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 253/541] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:53.006691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:53.007295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:53.013667 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:53.014112 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:53.014880 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:53.015314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:53.029468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 HTTP/1.1 May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:48:53.031118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:48:53.032435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '959c1a20-6a14-4d41-a7a4-f7eded2fc759'} May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:48:53.033182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:48:53.034384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:48:53.035639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:48:53.035639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-197cd593-fc42-4119-86ed-638b1cc7df85 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 404 len: 111 microversion: 2.1 time: 0.030360 May 12 17:48:53.035639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 289/542] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:53 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:48:53.042618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-263fd1ba-7cd2-49cc-8272-5d10ff4cb31b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '.version_select at 0x7fc0c622e3a0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:53.059342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-263fd1ba-7cd2-49cc-8272-5d10ff4cb31b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702367950" status: 202 len: 0 microversion: 2.1 time: 0.020941 May 12 17:48:53.059967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 254/543] 10.222.0.73 () {58 vars in 1220 bytes} [Thu May 12 17:48:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702367950 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:48:53.711404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aec2ab4a-98a0-48a8-81a1-65e145ee7008 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: .version_select at 0x7fc0c59011f0>, body: {"keypair": {"name": "tempest-keypair-2133706448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEr5O/hrohNpxlVeXOKJON+sfFC5MtJI6LIoYQGENaCCE4VhbSxyOWs7ZOmeP+iaK0NGrHzGZy1VTf9rEtHcKIpN85wjmWbXVI6jIDh24R3hxleBl5P2jiVtPXhfKtSeYg=="}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:53.724997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-aec2ab4a-98a0-48a8-81a1-65e145ee7008 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:53.728680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-aec2ab4a-98a0-48a8-81a1-65e145ee7008 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:53.753694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aec2ab4a-98a0-48a8-81a1-65e145ee7008 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045570 May 12 17:48:53.754329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 290/544] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:48:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:48:54.910576 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:54.911193 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:54.918428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:54.918881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:54.919659 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:54.920099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.046476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lazy-loading 'services' on Instance uuid 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:48:55.177147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a6f682de-488a-4461-bc6e-029920052367 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441/os-volume_attachments/dbaf59b1-d900-410a-a44e-14780c6df11a" status: 202 len: 0 microversion: 2.1 time: 0.271536 May 12 17:48:55.181079 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 255/545] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:48:54 2022] DELETE /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441/os-volume_attachments/dbaf59b1-d900-410a-a44e-14780c6df11a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:48:55.307946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1088110064", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1221ba24-0e4c-4509-ac6d-bff82c57688b"}], "security_groups": [{"name": "tempest-securitygroup--1173675354"}], "key_name": "tempest-keypair-2133706448", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:55.407522 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] validate_networks() for [('1221ba24-0e4c-4509-ac6d-bff82c57688b', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:48:55.773867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:48:55.774363 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:48:55.774837 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:48:55.775261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:48:55.775692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:48:55.784261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.784777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.785614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:55.786049 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:55.802483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:48:55.806274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:48:55.817755 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:48:55.820000 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:48:55.865458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-86c48656-e0cf-4e56-88a2-700854c6df92 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562258 May 12 17:48:55.867495 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 291/546] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:48:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:48:55.877194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cdb1f545-6088-4656-a4a3-625fd2ee9742 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:55.877909 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cdb1f545-6088-4656-a4a3-625fd2ee9742 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:55.945448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cdb1f545-6088-4656-a4a3-625fd2ee9742 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:55.952917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cdb1f545-6088-4656-a4a3-625fd2ee9742 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1242 microversion: 2.1 time: 0.080315 May 12 17:48:55.953563 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 256/547] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:55 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:56.299271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:56.300328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:56.310687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.311348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.311906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.312399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.337778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:48:56.418247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-df67c555-11ea-448c-b12e-cb90f76430ba tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 204 len: 0 microversion: 2.1 time: 0.122787 May 12 17:48:56.418833 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 292/548] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:48:56 2022] DELETE /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:48:56.427837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:56.428824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:56.436217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.436600 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.437796 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.438236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.568403 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:56.575609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b2ff206a-845f-4d53-a4ec-30fa21817c0d tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1513 microversion: 2.1 time: 0.152423 May 12 17:48:56.576194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 257/549] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:56 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:48:56.970754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:56.971364 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:56.977788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.978231 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:56.978983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:56.979416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:57.041444 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:57.049913 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-83683e21-0c01-42c2-abdf-5a2dcc50f657 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1238 microversion: 2.1 time: 0.083404 May 12 17:48:57.050500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 293/550] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:56 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:57.592627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:57.593154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:57.600424 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:57.600884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:57.601658 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:57.602104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:57.730193 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:57.737463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a5bc4f95-7085-4570-9f7f-c8258cb449a7 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1513 microversion: 2.1 time: 0.149217 May 12 17:48:57.738040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 258/551] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:57 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:58.067927 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:58.068609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:58.074882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:58.075330 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:58.076097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:58.076556 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:58.135786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:58.142837 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-735c3c09-8e83-42d9-b837-89bf5dc33432 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1238 microversion: 2.1 time: 0.078714 May 12 17:48:58.143406 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 294/552] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:58 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:58.755800 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:58.756438 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:58.762675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:58.763129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:58.763913 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:58.764398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:58.893656 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:58.901540 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5c2b7f75-bf28-42ad-aa53-af563fa8f5bf tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1513 microversion: 2.1 time: 0.150618 May 12 17:48:58.902112 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 259/553] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:58 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:59.159839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:59.161030 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:59.167193 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.167650 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.168447 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.168886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.235807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:48:59.243839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e34cedfa-f28d-4cfb-8579-7a9d958e546d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1294 microversion: 2.1 time: 0.087684 May 12 17:48:59.245060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 295/554] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:59 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:48:59.728044 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-0d221d48-f85b-4c33-9c5e-fe4876be66d4 req-35a13482-2d1c-4c6b-94d2-4c24fc475fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d36b24d-a1c7-4a2a-9ba1-f19c815aa441", "name": "network-vif-deleted", "tag": "02ed1688-bc56-4512-920a-ee5a4af2eed2"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:48:59.736747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-0d221d48-f85b-4c33-9c5e-fe4876be66d4 req-35a13482-2d1c-4c6b-94d2-4c24fc475fb5 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.737196 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-0d221d48-f85b-4c33-9c5e-fe4876be66d4 req-35a13482-2d1c-4c6b-94d2-4c24fc475fb5 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.748662 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-0d221d48-f85b-4c33-9c5e-fe4876be66d4 req-35a13482-2d1c-4c6b-94d2-4c24fc475fb5 service nova] Creating event network-vif-deleted:02ed1688-bc56-4512-920a-ee5a4af2eed2 for instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 on hv-cinder-84052 May 12 17:48:59.753780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-0d221d48-f85b-4c33-9c5e-fe4876be66d4 req-35a13482-2d1c-4c6b-94d2-4c24fc475fb5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029439 May 12 17:48:59.754629 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 260/555] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:48:59.920416 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:48:59.921037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:48:59.927470 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.927852 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.928658 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.929094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.959572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:48:59.960023 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:48:59.960511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lazy-loading 'fault' on Instance uuid 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:00.003503 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad6490c8b8249b1b2abcb0f359330df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef859014e4d4ff79fb7958511f20d11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:00.010887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f8bc766b-5b8d-44e0-b952-0d5172444115 tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 200 len: 1308 microversion: 2.1 time: 0.094904 May 12 17:49:00.011466 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 296/556] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:48:59 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:00.268311 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:00.279242 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:00.288741 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:00.289451 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:00.290438 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:00.291052 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:00.462050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:00.469825 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a85e32c7-0a11-4409-b784-4ed283929c2f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.210764 May 12 17:49:00.473524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 261/557] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:00 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:01.027652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:01.029870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] [instance: 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:01.037238 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.037682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.038520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.038962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.053687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] HTTP exception thrown: Instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 could not be found. May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Request method failure captured: May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 HTTP/1.1 May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUf4vVSZfDhvnLnJ2FY0st57LsBoVOvbAmNndJvQaTANYy-cZlCCDOVbh_7USMLntq4Ufr1CmSFqLW4YC4-Tty0v9bjerlB9H-wsbuJ_Q93OPrtY8Yw_LVgIgAFd-VlaTXqT2BPj0GoXfxdc9Elqgj-Ze2XyLa2TusZaa4rr_Oi7fMM May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 7ef859014e4d4ff79fb7958511f20d11 May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1083133363 May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:49:01.055221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7ef859014e4d4ff79fb7958511f20d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7ef859014e4d4ff79fb7958511f20d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7ef859014e4d4ff79fb7958511f20d11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7ef859014e4d4ff79fb7958511f20d11", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesSnapshotTestJSON-1083133363 May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 7ef859014e4d4ff79fb7958511f20d11 May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1083133363 May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesSnapshotTestJSON-1083133363-project May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 5ad6490c8b8249b1b2abcb0f359330df May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesSnapshotTestJSON-1083133363-project May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 could not be found. May 12 17:49:01.056631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '7d36b24d-a1c7-4a2a-9ba1-f19c815aa441'} May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 could not be found. May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:01.057460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 could not be found. May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 could not be found. May 12 17:49:01.058674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:01.059714 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] Returning 404 to user: Instance 7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:01.059714 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6855467b-2bb0-4543-9c7b-670eb0c8ccef tempest-VolumesSnapshotTestJSON-1083133363 tempest-VolumesSnapshotTestJSON-1083133363-project] 10.222.0.73 "GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441" status: 404 len: 111 microversion: 2.1 time: 0.033731 May 12 17:49:01.059714 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 297/558] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:01 2022] GET /compute/v2.1/servers/7d36b24d-a1c7-4a2a-9ba1-f19c815aa441 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:49:01.487044 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:01.487587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:01.494038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.494492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.495263 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.495707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.625157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:01.633209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-15382172-a4b3-4b2f-8ccf-6194a5e9a1a7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.150149 May 12 17:49:01.633774 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 262/559] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:01 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:01.770997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-dd245bc4-f8f5-415a-83d9-a78a3a5fddf7 req-00cc1ef7-5bfa-4ed3-8c80-6011a9fafda0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a503b1e5-5436-4a5d-bea7-646c0f541e12", "tag": "e033835a-7af5-4643-bc44-3aa48f300548"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:01.779043 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-dd245bc4-f8f5-415a-83d9-a78a3a5fddf7 req-00cc1ef7-5bfa-4ed3-8c80-6011a9fafda0 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:01.779492 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-dd245bc4-f8f5-415a-83d9-a78a3a5fddf7 req-00cc1ef7-5bfa-4ed3-8c80-6011a9fafda0 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:01.793936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-dd245bc4-f8f5-415a-83d9-a78a3a5fddf7 req-00cc1ef7-5bfa-4ed3-8c80-6011a9fafda0 service nova] Creating event network-changed:e033835a-7af5-4643-bc44-3aa48f300548 for instance a503b1e5-5436-4a5d-bea7-646c0f541e12 on hv-cinder-84052 May 12 17:49:01.798887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-dd245bc4-f8f5-415a-83d9-a78a3a5fddf7 req-00cc1ef7-5bfa-4ed3-8c80-6011a9fafda0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 May 12 17:49:01.799481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 298/560] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:02.649348 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:02.650005 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:02.656453 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.656915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.657763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:02.658236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:02.786071 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:02.793804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c19db25e-0f1d-4a75-83ae-b233502f32c2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.148184 May 12 17:49:02.794406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 263/561] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:02 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:03.645255 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1abeb1c4-27b3-4bff-aadf-444a8902f37e"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:03.646384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:03.652791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.653234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.653986 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.654420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.811924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:03.812492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:03.819512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.819965 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.820759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:03.821200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:03.945786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:03.953186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-919cf369-6a58-4bef-b486-fe0699c350aa tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.145146 May 12 17:49:03.953766 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 264/562] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:03 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:04.969857 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:04.970524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:04.976944 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:04.977386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:04.978477 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:04.978932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:05.107119 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:05.114886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dbe587b2-96cc-41f9-ad47-22a23e8e3486 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.148851 May 12 17:49:05.115484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 265/563] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:04 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:05.519274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a8e6f5a2-b939-48be-a84a-0860dfe57e30 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.878733 May 12 17:49:05.526004 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 299/564] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:49:03 2022] POST /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments => generated 194 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:06.132932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:06.133797 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:06.140796 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:06.141241 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:06.142004 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:06.142439 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:06.271599 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:06.278817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-510b5145-6239-436f-9da1-487d2d8142ae tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.151021 May 12 17:49:06.279397 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 266/565] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:06 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:07.297511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:07.298163 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:07.306426 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.306912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.307797 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:07.308265 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:07.447596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:07.456761 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-545e5335-5235-4bba-9aef-04c50d2bd917 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.163982 May 12 17:49:07.457372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 300/566] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:07 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:07.999592 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-b3faded5-520d-4cb2-b344-c08ba4f79d6c req-613e6af4-3eab-479b-9fee-9cf5c43cd730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a503b1e5-5436-4a5d-bea7-646c0f541e12", "name": "network-vif-plugged", "status": "completed", "tag": "e033835a-7af5-4643-bc44-3aa48f300548"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:08.010204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-b3faded5-520d-4cb2-b344-c08ba4f79d6c req-613e6af4-3eab-479b-9fee-9cf5c43cd730 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.010688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-b3faded5-520d-4cb2-b344-c08ba4f79d6c req-613e6af4-3eab-479b-9fee-9cf5c43cd730 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.024895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-b3faded5-520d-4cb2-b344-c08ba4f79d6c req-613e6af4-3eab-479b-9fee-9cf5c43cd730 service nova] Creating event network-vif-plugged:e033835a-7af5-4643-bc44-3aa48f300548 for instance a503b1e5-5436-4a5d-bea7-646c0f541e12 on hv-cinder-84052 May 12 17:49:08.030054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-b3faded5-520d-4cb2-b344-c08ba4f79d6c req-613e6af4-3eab-479b-9fee-9cf5c43cd730 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034082 May 12 17:49:08.030674 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 267/567] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:08.473613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:08.474895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:08.481259 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.481713 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.482577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:08.482918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:08.627289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:08.635311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-efeb0a0a-144e-4f26-bf3f-13501bae4f82 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.165685 May 12 17:49:08.635873 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 301/568] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:08 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:09.652982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:09.653746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:09.659835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:09.660340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:09.661116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:09.661861 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:09.793868 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:09.801507 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d3e9fb3a-b7bc-416a-bcb6-dee52bf7afe9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1368 microversion: 2.1 time: 0.153141 May 12 17:49:09.802703 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 268/569] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:09 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:10.818993 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:10.819614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:10.826246 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:10.826596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:10.827372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:10.827810 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:10.957234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:10.964469 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7ee023f3-f1ea-4abf-9bdf-1887426f4e7d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1557 microversion: 2.1 time: 0.149539 May 12 17:49:10.965038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 302/570] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:10 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:10.981500 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:10.981978 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:10.988210 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:10.988670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:10.990003 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:10.990457 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:11.064716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dee1f651-314e-446f-8905-a2de5698a636 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087061 May 12 17:49:11.065310 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 269/571] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:49:10 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:12.020476 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-f3c57882-09e5-40de-8c9a-94038aae6cec req-f42b6ab6-6b64-4fb8-96dd-efff7a4908c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a503b1e5-5436-4a5d-bea7-646c0f541e12", "tag": "e033835a-7af5-4643-bc44-3aa48f300548"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:12.029353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f3c57882-09e5-40de-8c9a-94038aae6cec req-f42b6ab6-6b64-4fb8-96dd-efff7a4908c3 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.029873 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f3c57882-09e5-40de-8c9a-94038aae6cec req-f42b6ab6-6b64-4fb8-96dd-efff7a4908c3 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.041136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-f3c57882-09e5-40de-8c9a-94038aae6cec req-f42b6ab6-6b64-4fb8-96dd-efff7a4908c3 service nova] Creating event network-changed:e033835a-7af5-4643-bc44-3aa48f300548 for instance a503b1e5-5436-4a5d-bea7-646c0f541e12 on hv-cinder-84052 May 12 17:49:12.046083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-f3c57882-09e5-40de-8c9a-94038aae6cec req-f42b6ab6-6b64-4fb8-96dd-efff7a4908c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029192 May 12 17:49:12.046670 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 303/572] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:12.730277 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:12.730825 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:12.737823 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.738484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.740202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.740675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.772296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-40bdd6f5-bbaa-4f0d-9638-b4dd9ef9af03 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments/d4b36827-55bc-409c-9d25-df0224eec10c" status: 200 len: 194 microversion: 2.20 time: 0.046701 May 12 17:49:12.773238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 270/573] 10.222.0.73 () {60 vars in 1453 bytes} [Thu May 12 17:49:12 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments/d4b36827-55bc-409c-9d25-df0224eec10c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:49:12.840522 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:12.841186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:12.847654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.848291 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.849911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:12.850542 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:12.939541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lazy-loading 'services' on Instance uuid 022cd56e-632d-4336-a6d1-4de0c1952705 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:13.016649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f92d8001-9b4e-4f0f-983c-a6e6ed8ab7f3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments/d4b36827-55bc-409c-9d25-df0224eec10c" status: 202 len: 0 microversion: 2.20 time: 0.181451 May 12 17:49:13.017212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 304/574] 10.222.0.73 () {60 vars in 1456 bytes} [Thu May 12 17:49:12 2022] DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments/d4b36827-55bc-409c-9d25-df0224eec10c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 17:49:13.027580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:13.028820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:13.034669 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:13.035116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:13.035880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:13.037110 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:13.066020 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b4610bd0-a281-47d1-88b5-7b8903047f6a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042374 May 12 17:49:13.066579 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 271/575] 10.222.0.73 () {60 vars in 1342 bytes} [Thu May 12 17:49:13 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:49:14.076103 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:14.077429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:14.080842 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:14.082193 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:14.084912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.085633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.086634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.087319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.092566 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.093027 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.093827 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.094267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.115062 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lazy-loading 'flavor' on Instance uuid a9b5a3c0-ae83-4249-9ac3-dddc8a328712 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:14.128390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4789f8ef-58d4-40ff-82e5-544582e40f9d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053970 May 12 17:49:14.128964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 272/576] 10.222.0.73 () {60 vars in 1342 bytes} [Thu May 12 17:49:14 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:49:14.249283 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3c722278-008f-458d-9a86-4ff4fc54d8a7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/action" status: 200 len: 32 microversion: 2.1 time: 0.177479 May 12 17:49:14.249903 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 305/577] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:49:14 2022] POST /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:49:14.260948 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:14.261993 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:14.267713 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.268173 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.268969 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:14.269444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:14.405513 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:14.413573 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-685ac6bc-c9d2-4ba0-845c-8fd93518c819 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.156607 May 12 17:49:14.414152 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 273/578] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:14 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:15.142858 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:15.144025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:15.150136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.150582 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.151347 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.151779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.180388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a5a1d7fb-7ca1-443b-a10e-3cb3bd5e7671 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042392 May 12 17:49:15.180946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 306/579] 10.222.0.73 () {60 vars in 1342 bytes} [Thu May 12 17:49:15 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:15.241052 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:15.241587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:15.248772 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.249231 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.250046 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.250671 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.277915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:49:15.350501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-54cba281-72e4-464f-ad37-f5a7b4b5fc67 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 204 len: 0 microversion: 2.20 time: 0.113891 May 12 17:49:15.351152 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 274/580] 10.222.0.73 () {60 vars in 1279 bytes} [Thu May 12 17:49:15 2022] DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 17:49:15.360724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:15.361396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:15.368575 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.369036 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.369812 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.370257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.432272 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:15.433165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:15.439017 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.439527 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.440531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:15.441012 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:15.537762 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.549476 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.550997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.553062 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-15011d37-eb26-4879-ba30-ec705d0f5566 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.196219 May 12 17:49:15.553630 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 307/581] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:15 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:15.605097 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:15.612821 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-74ab48bf-8f06-48f5-a723-bf094dec352f tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.185747 May 12 17:49:15.613390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 275/582] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:15 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:16.573333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:16.573908 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:16.581113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:16.581591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:16.582451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:16.583130 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:16.630819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:16.631443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:16.637820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:16.638272 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:16.639048 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:16.639486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:16.752969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:16.760995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:16.762478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:16.763620 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7b1f7ac4-4880-45d2-ba02-b7e26e80b1f8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.194433 May 12 17:49:16.764201 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 308/583] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:16 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:16.797465 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:16.805234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f12e6f73-c810-436b-8117-0bfd43915ce4 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.179236 May 12 17:49:16.805802 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 276/584] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:16 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:17.785429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.785429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:17.794311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:17.794951 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:17.795767 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:17.796233 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:17.822157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:17.822852 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:17.829204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:17.829651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:17.830677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:17.831181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:18.009520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.017953 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.020062 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.022009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9544685a-e1ae-4d1c-b4c0-c6ac67e8ee74 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 200 len: 1724 microversion: 2.20 time: 0.241667 May 12 17:49:18.022774 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 309/585] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:18.035309 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:18.043622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-57982f10-bf4f-4d21-8fa5-d9e92786a0c6 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.225223 May 12 17:49:18.044202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 277/586] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:17 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:18.183904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7192aa5e-7aff-4a16-8d0f-4c08a74be0c1 req-a5568f81-f96d-409e-8381-94900d379899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022cd56e-632d-4336-a6d1-4de0c1952705", "name": "network-vif-deleted", "tag": "d9f2a285-130e-4f34-94a9-bbbfdf591d01"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:18.194550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7192aa5e-7aff-4a16-8d0f-4c08a74be0c1 req-a5568f81-f96d-409e-8381-94900d379899 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:18.195013 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7192aa5e-7aff-4a16-8d0f-4c08a74be0c1 req-a5568f81-f96d-409e-8381-94900d379899 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:18.207192 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7192aa5e-7aff-4a16-8d0f-4c08a74be0c1 req-a5568f81-f96d-409e-8381-94900d379899 service nova] Creating event network-vif-deleted:d9f2a285-130e-4f34-94a9-bbbfdf591d01 for instance 022cd56e-632d-4336-a6d1-4de0c1952705 on hv-cinder-84052 May 12 17:49:18.213049 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-7192aa5e-7aff-4a16-8d0f-4c08a74be0c1 req-a5568f81-f96d-409e-8381-94900d379899 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 May 12 17:49:18.214110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 310/587] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:19.039764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:19.040505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:19.047245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:19.047779 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:19.048690 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:19.049206 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:19.061654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:19.062345 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:19.064338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] HTTP exception thrown: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Request method failure captured: May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 HTTP/1.1 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUejmdt6rAIaAFrKJOqG7bqEez8hv2Y2C8dLWHYxIEFzg6o3B9uLf-uJoXgVbZpdN-n7mRvAOttIaD7R3dGSFxOu2iSI1hUT0Iq3jU_ghIeG2HX4FkMS5F8XCf7cyfgGh5yfwPh1JnUr_2AYXn0PGiILv0pRERPNs3tzRp5yNNnijl4 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:49:19.066014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bdb0d817bd8e4eeca5ed6229a4b5c53a", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 7a2b51125e9645dc9454042f49ff3659 May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:49:19.067456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '022cd56e-632d-4336-a6d1-4de0c1952705'} May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:19.069150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:49:19.070738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:49:19.072921 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Returning 404 to user: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:19.072921 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-16d0c77e-9d79-477b-9f92-d95b8093040f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 404 len: 111 microversion: 2.20 time: 0.031606 May 12 17:49:19.072921 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 278/588] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:19 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:49:19.073161 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:19.073161 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:19.074076 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:19.076596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:19.078780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-728314f9-4a17-4938-817e-9be49f46cdee tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '.version_select at 0x7fc0c61031f0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:19.097935 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-728314f9-4a17-4938-817e-9be49f46cdee tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039870651" status: 204 len: 0 microversion: 2.20 time: 0.022748 May 12 17:49:19.098640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 279/589] 10.222.0.73 () {60 vars in 1261 bytes} [Thu May 12 17:49:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039870651 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:49:19.227983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:19.237168 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a602d9c9-f21d-4871-83c4-11826bb98aa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.179585 May 12 17:49:19.247721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 311/590] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:19 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:19.772245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9f02c58b-dc85-4f5f-ab7d-0572a3c991b8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'create', calling method: .version_select at 0x7fc0c6202af0>, body: {"keypair": {"name": "tempest-keypair-2092069408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpRZ9DJ4mcbTgw13sadropMy9l/cX6t/KJ/12nbwPatwhPYziOwwfktt/NTz8J/hCq3PR1QARre0n9IgCs5b7rctsGvEh8Uc60wRhxpFX4/iNF5BEznfOEyaRP9fL4psQ=="}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:19.783832 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-9f02c58b-dc85-4f5f-ab7d-0572a3c991b8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:49:19.788359 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-9f02c58b-dc85-4f5f-ab7d-0572a3c991b8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for user 7a2b51125e9645dc9454042f49ff3659 and project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:49:19.809779 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9f02c58b-dc85-4f5f-ab7d-0572a3c991b8 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044860 May 12 17:49:19.810370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 280/591] 10.222.0.73 () {62 vars in 1199 bytes} [Thu May 12 17:49:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 17:49:20.255063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:20.256299 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:20.269668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:20.270129 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:20.271691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:20.272137 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:20.408091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:20.417597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-87879d1a-a5b5-454a-a62b-12630a892c2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.166627 May 12 17:49:20.418092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 312/592] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:20 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:21.093794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2119330778", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4a1943f-5104-4c36-90a4-e3e9daad3559"}], "security_groups": [{"name": "tempest-securitygroup--1343582043"}], "key_name": "tempest-keypair-2092069408", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:21.191329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] validate_networks() for [('a4a1943f-5104-4c36-90a4-e3e9daad3559', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:49:21.434989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:21.435580 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:21.442162 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:21.443147 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:21.444015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:21.444483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:21.625293 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:49:21.625717 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:49:21.626187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:49:21.626982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:49:21.627397 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:49:21.636334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:21.636923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:21.637724 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:21.638163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:21.639600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:21.647492 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3d98448a-eb66-4924-bfc4-ef931e6c6efa tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.216349 May 12 17:49:21.648073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 313/593] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:21 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:49:21.654014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:49:21.657844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Getting quotas for user 7a2b51125e9645dc9454042f49ff3659 and project bdb0d817bd8e4eeca5ed6229a4b5c53a. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:49:21.669185 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:49:21.671428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:49:21.715735 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4b9fd1a6-45b8-4978-926c-5b97d8c2b30b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.626588 May 12 17:49:21.716519 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 281/594] 10.222.0.73 () {62 vars in 1187 bytes} [Thu May 12 17:49:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 17:49:21.726696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7b125061-8c2d-4a9d-8914-8b45115578cb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:21.727296 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7b125061-8c2d-4a9d-8914-8b45115578cb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:21.780039 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b125061-8c2d-4a9d-8914-8b45115578cb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:21.788806 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b125061-8c2d-4a9d-8914-8b45115578cb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:21.790390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b125061-8c2d-4a9d-8914-8b45115578cb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:21.791554 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7b125061-8c2d-4a9d-8914-8b45115578cb tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1282 microversion: 2.20 time: 0.069279 May 12 17:49:21.792808 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 314/595] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:21 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:22.665416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:22.666071 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:22.672932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:22.673374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.674187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:22.674960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.811761 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:22.812771 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:22.819827 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.820410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:22.820857 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.821657 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:22.822091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:22.827980 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c6c7c3d5-1f1a-41d0-a13a-6ded1cdf60b8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.167283 May 12 17:49:22.828575 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 282/596] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:22 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:22.888560 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.896822 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.899434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:22.901125 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-57cc8c5f-82a1-4895-b4c2-eef12e10af2b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1340 microversion: 2.20 time: 0.094260 May 12 17:49:22.901978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 315/597] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:22 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:23.844966 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:23.845787 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:23.853307 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:23.853812 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:23.854778 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:23.855297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:23.927113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:23.928987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:23.935942 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:23.936568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:23.937453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:23.938016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.329353 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.341844 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dac092d0-22e4-48f3-8d71-c2b04db632b2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.500714 May 12 17:49:24.354307 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 283/598] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:23 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:24.359992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-59bc80ea-604d-471d-9896-6e21807c1187 req-23319c59-502e-4b30-8be0-53f925e10d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:24.373912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-59bc80ea-604d-471d-9896-6e21807c1187 req-23319c59-502e-4b30-8be0-53f925e10d4e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:24.375245 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-59bc80ea-604d-471d-9896-6e21807c1187 req-23319c59-502e-4b30-8be0-53f925e10d4e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:24.393542 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-59bc80ea-604d-471d-9896-6e21807c1187 req-23319c59-502e-4b30-8be0-53f925e10d4e service nova] Creating event network-changed:21439de2-974d-41f9-905c-3ce53b19c55a for instance f637252f-a0d3-4c28-865d-6bebe0284c94 on hv-cinder-84052 May 12 17:49:24.400650 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-59bc80ea-604d-471d-9896-6e21807c1187 req-23319c59-502e-4b30-8be0-53f925e10d4e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044734 May 12 17:49:24.401798 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 284/599] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:24.410206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.420464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.422193 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:24.423914 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b846dbff-c8cc-40ad-8728-8d4faf402681 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.501604 May 12 17:49:24.425052 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 316/600] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:23 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:25.361095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:25.361879 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:25.368725 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.369265 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.370126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.370668 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.442778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:25.443379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:25.452319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.452764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.453706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:25.454136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:25.545751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.556231 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0e591699-7029-4968-8581-2c6acf500424 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.199779 May 12 17:49:25.557108 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 285/601] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:25 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:25.642985 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.652189 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.653697 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:25.654816 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-12b4308a-e0cc-4896-85c6-d946cb6f3e2a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.216014 May 12 17:49:25.655753 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 317/602] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:25 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:49:26.575393 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:26.575933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:26.587008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.587461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.588286 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.588736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.675133 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:26.677393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:26.693526 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.694989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.695995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:26.696627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:26.757682 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.776132 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a7310aec-c3f0-4a70-928d-2c30e78bbbd2 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.204920 May 12 17:49:26.789224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 286/603] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:26 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:26.889984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.899495 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.901073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:26.902395 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a713f423-bb6b-4ede-951b-be51ae9fd92a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.232736 May 12 17:49:26.903862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 318/604] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:26 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:49:27.795936 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:27.797159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:27.805635 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.806018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.806976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.807579 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.923386 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:27.924423 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:27.942094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.942715 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:27.943568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:27.944712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:28.017107 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.041426 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b2574812-c641-4df8-afec-3d568c30ab93 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.250091 May 12 17:49:28.059283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 287/605] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:27 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:28.283082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.301924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.303722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:28.305406 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7b6f87e6-91af-458f-a081-eb59fb643181 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.388020 May 12 17:49:28.306730 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 319/606] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:27 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:29.069177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:29.069847 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:29.076264 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.076719 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.077496 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.077932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.281908 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:29.296317 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1cc3c41b-ad6a-4751-b91e-7cb16cb60dc0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.235799 May 12 17:49:29.298864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 288/607] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:29 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:29.327003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:29.327850 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:29.336583 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.337186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.338370 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:29.339341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:29.576124 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:29.590514 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:29.591931 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:29.593088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d075d969-07db-446b-b411-19ab812825f9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.272662 May 12 17:49:29.594210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 320/608] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:29 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:30.141755 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-aaa405ef-73de-4481-b12f-5afdbd45b419 req-9f29eba3-93d1-473f-8d37-0b81fc1b3d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "name": "network-vif-plugged", "status": "completed", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:30.153876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-aaa405ef-73de-4481-b12f-5afdbd45b419 req-9f29eba3-93d1-473f-8d37-0b81fc1b3d8c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.154195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-aaa405ef-73de-4481-b12f-5afdbd45b419 req-9f29eba3-93d1-473f-8d37-0b81fc1b3d8c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.168244 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-aaa405ef-73de-4481-b12f-5afdbd45b419 req-9f29eba3-93d1-473f-8d37-0b81fc1b3d8c service nova] Creating event network-vif-plugged:21439de2-974d-41f9-905c-3ce53b19c55a for instance f637252f-a0d3-4c28-865d-6bebe0284c94 on hv-cinder-84052 May 12 17:49:30.174466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-aaa405ef-73de-4481-b12f-5afdbd45b419 req-9f29eba3-93d1-473f-8d37-0b81fc1b3d8c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036281 May 12 17:49:30.175579 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 289/609] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:30.320599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:30.322403 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:30.330686 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.331816 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.332884 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.333409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.481432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.489185 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7077b623-7be9-46d4-9ab7-dfd59b97d879 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.176361 May 12 17:49:30.489759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 321/610] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:30 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:30.618114 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:30.618741 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:30.625029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.625752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.626784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:30.627226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:30.835398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.843252 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.845081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:30.846455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-29a4bd7f-f2a0-4d4c-87d5-d9aa08443337 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.237631 May 12 17:49:30.847144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 290/611] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:30 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:31.508206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:31.508983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:31.515505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.516077 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.517015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.517755 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.719702 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:31.728567 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4c05feaf-6eb4-4c3c-9887-d73f3c2d6092 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.225148 May 12 17:49:31.739059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 322/612] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:31 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:31.866450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:31.867259 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:31.874286 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.874741 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:31.875527 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:31.875972 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.023191 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.031589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.033646 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.035005 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-969c7208-8546-46a5-ad1f-6a8802b2c0a1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1408 microversion: 2.20 time: 0.173141 May 12 17:49:32.035568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 291/613] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:31 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:32.747796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:32.749579 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:32.759300 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.761270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.762347 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:32.763513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:32.980879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:32.994338 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4ec8e1ef-41d5-43c3-b064-6d11e4f25446 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.252876 May 12 17:49:32.995788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 323/614] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:32 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:33.057207 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:33.057830 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:33.069390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.070341 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.071802 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.072770 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.305707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:33.330347 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:33.332430 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:33.335552 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5d801406-cab5-4976-a5c4-2dc39ca06e9f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1600 microversion: 2.20 time: 0.282905 May 12 17:49:33.337623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 292/615] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:49:33 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1600 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:49:33.355874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:33.358187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:33.366843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.367586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.368794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:33.369417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:33.481499 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f3116e2d-9afa-483d-8bd8-a902e62166db tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129727 May 12 17:49:33.482329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 324/616] 10.222.0.73 () {60 vars in 1315 bytes} [Thu May 12 17:49:33 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:49:34.014562 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:34.015180 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:34.026583 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:34.030126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.031804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:34.034370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:34.814871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:34.826718 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e58dd56d-6ec8-4549-82a8-2f5d7a1cc128 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1735 microversion: 2.1 time: 0.817590 May 12 17:49:34.849612 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 293/617] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:34 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1735 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:35.378444 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-b04cbbbc-c249-49c1-bba1-d36725d1de46 req-2a8b51fa-a9c3-4988-871b-fbf8b62666d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:35.409398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-b04cbbbc-c249-49c1-bba1-d36725d1de46 req-2a8b51fa-a9c3-4988-871b-fbf8b62666d8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.412074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-b04cbbbc-c249-49c1-bba1-d36725d1de46 req-2a8b51fa-a9c3-4988-871b-fbf8b62666d8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.453247 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-b04cbbbc-c249-49c1-bba1-d36725d1de46 req-2a8b51fa-a9c3-4988-871b-fbf8b62666d8 service nova] Creating event network-changed:21439de2-974d-41f9-905c-3ce53b19c55a for instance f637252f-a0d3-4c28-865d-6bebe0284c94 on hv-cinder-84052 May 12 17:49:35.464148 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-b04cbbbc-c249-49c1-bba1-d36725d1de46 req-2a8b51fa-a9c3-4988-871b-fbf8b62666d8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089965 May 12 17:49:35.464781 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 325/618] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:35.855485 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:35.857751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:35.871960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.872898 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:35.874383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:35.875226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.198924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:36.218268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0f3597a4-ca4e-4a19-88cf-c96ad7397434 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1715 microversion: 2.1 time: 0.366558 May 12 17:49:36.234755 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 294/619] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:35 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1715 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:36.448341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:36.449630 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:36.463841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.464796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.465793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.466411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.656977 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] HTTP exception thrown: Cannot 'detach_volume' instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 while it is in vm_state rescued May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Request method failure captured: May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments/1abeb1c4-27b3-4bff-aadf-444a8902f37e HTTP/1.1 May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUempJqBkrdawMuXNw3bGhubgy7zT209G1Bw9kNOHCSoGyVqSk_JWhDZZpbuaiXR30BdGwKWbBfZiXLWF7aKv0vNq5w5HClxXzYWwsjn4NnUaRe4jnNLfpORFw2f_MVLsgh55kz6SOlGxBxFgOpCHXmodxJyhzFc3hsxLtyhwbwsyr8 May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:49:36.658728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_202db80dae2446e2b9cd1124b2925ced", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 298a13924a864f61adf6e4085e569358 May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:49:36.660594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Cannot 'detach_volume' instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 while it is in vm_state rescued May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'server_id': 'a9b5a3c0-ae83-4249-9ac3-dddc8a328712', 'id': '1abeb1c4-27b3-4bff-aadf-444a8902f37e'} May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:36.661313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 while it is in vm_state rescued May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 while it is in vm_state rescued May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:36.663504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Returning 409 to user: Cannot 'detach_volume' instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 while it is in vm_state rescued {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:36.665520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f8355202-db5c-413e-b053-c55b00fe4059 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments/1abeb1c4-27b3-4bff-aadf-444a8902f37e" status: 409 len: 152 microversion: 2.1 time: 0.220049 May 12 17:49:36.674865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 326/620] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:49:36 2022] DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments/1abeb1c4-27b3-4bff-aadf-444a8902f37e => generated 152 bytes in 235 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 17:49:36.681526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:36.682072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:36.694976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.697504 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.700211 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.700668 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.827491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-704b02f5-72e8-4a8f-966b-b7cc8f91c01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "POST /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/action" status: 202 len: 0 microversion: 2.1 time: 0.148628 May 12 17:49:36.828545 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 295/621] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:49:36 2022] POST /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:49:36.838132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:36.838879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:36.854409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.855437 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:36.856555 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:36.857234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:37.070872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:37.085147 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-257fb5c9-be56-4356-a474-c6467366c1f8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1723 microversion: 2.1 time: 0.251317 May 12 17:49:37.086059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 327/622] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:36 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:37.204049 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f53316f2-bc48-4c26-81ac-d7931b8b26eb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Action: 'create', calling method: .version_select at 0x7fc0c60c7790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1380938625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2T+wrb7ah1jmHihQFKCZnRXbJ3Gem3+6Y9kgQqP6yuURe30KPf93zhvf0+8Z2n1Bmjv5EqaKTYFyA5DCSCbrzQUQKi44zIzDIr927Vfb+ohJko8kQIT409pIq8oXeb1g=="}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:37.219508 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f53316f2-bc48-4c26-81ac-d7931b8b26eb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:49:37.223620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f53316f2-bc48-4c26-81ac-d7931b8b26eb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for user adbaa9b8b7e2447da5eef8f32aff22a1 and project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:49:37.247251 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f53316f2-bc48-4c26-81ac-d7931b8b26eb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.274004 May 12 17:49:37.248214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 296/623] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:49:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:38.103456 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:38.104074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:38.119724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.122689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.123904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:38.124429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:38.328409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:38.337268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-744e99c8-43c1-4700-9d22-8c4cbca4756b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1723 microversion: 2.1 time: 0.238216 May 12 17:49:38.337985 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 328/624] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:38 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:39.355541 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:39.356340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:39.363200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:39.363841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:39.364867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:39.365322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:39.528452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:39.537004 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6b59757a-c10d-4fe7-972e-4bdcbf7e6e68 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1723 microversion: 2.1 time: 0.185674 May 12 17:49:39.537620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 297/625] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:39 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:40.554609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:40.555327 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:40.562212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.562669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.563455 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.563898 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.703216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:40.711896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6b13b5a3-5318-4255-ba9b-af7d54410a9e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1729 microversion: 2.1 time: 0.161209 May 12 17:49:40.712501 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 329/626] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:40 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:40.730132 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:40.730679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:40.737470 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.737923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.738700 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:40.739138 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:40.822287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5e00cab7-480a-42ef-a24a-b0a79e7b67e5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097190 May 12 17:49:40.822964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 298/627] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:49:40 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:41.791295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-fb7f007d-e306-4f4e-9e6c-455350f2927b req-3b17a5ed-9b26-4f4e-bea3-2d9536f7beed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5a3c0-ae83-4249-9ac3-dddc8a328712", "tag": "bb2465e3-e5fd-4ae3-9017-cb6fa37925e6"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:41.802289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-fb7f007d-e306-4f4e-9e6c-455350f2927b req-3b17a5ed-9b26-4f4e-bea3-2d9536f7beed service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:41.802821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-fb7f007d-e306-4f4e-9e6c-455350f2927b req-3b17a5ed-9b26-4f4e-bea3-2d9536f7beed service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:41.818092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-fb7f007d-e306-4f4e-9e6c-455350f2927b req-3b17a5ed-9b26-4f4e-bea3-2d9536f7beed service nova] Creating event network-changed:bb2465e3-e5fd-4ae3-9017-cb6fa37925e6 for instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 on hv-cinder-84052 May 12 17:49:41.824017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-fb7f007d-e306-4f4e-9e6c-455350f2927b req-3b17a5ed-9b26-4f4e-bea3-2d9536f7beed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039117 May 12 17:49:41.825015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 330/628] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:43.839470 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-b6273d31-b01e-4be6-8a8e-fdf1994d3677 req-667a981c-d06b-44a5-9692-3dd41bd72152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b5a3c0-ae83-4249-9ac3-dddc8a328712", "tag": "bb2465e3-e5fd-4ae3-9017-cb6fa37925e6"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:43.847454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-b6273d31-b01e-4be6-8a8e-fdf1994d3677 req-667a981c-d06b-44a5-9692-3dd41bd72152 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:43.847905 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-b6273d31-b01e-4be6-8a8e-fdf1994d3677 req-667a981c-d06b-44a5-9692-3dd41bd72152 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:43.861155 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-b6273d31-b01e-4be6-8a8e-fdf1994d3677 req-667a981c-d06b-44a5-9692-3dd41bd72152 service nova] Creating event network-changed:bb2465e3-e5fd-4ae3-9017-cb6fa37925e6 for instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 on hv-cinder-84052 May 12 17:49:43.866042 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-b6273d31-b01e-4be6-8a8e-fdf1994d3677 req-667a981c-d06b-44a5-9692-3dd41bd72152 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030600 May 12 17:49:43.866624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 299/629] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:48.187729 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:48.188709 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:48.195425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.195866 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.196665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:48.197101 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:48.221608 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6f11d16a-1fcd-45b9-be7e-ab0d075e2b43 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/ips" status: 200 len: 149 microversion: 2.1 time: 0.040692 May 12 17:49:48.222189 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 331/630] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:49:48 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:49.545968 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33da2ecd-87e4-4aba-86b3-480440733bbe"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:49.547119 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:49.553350 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.554367 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.555177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:49.555651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:49.836519 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3b522de4-b577-4a28-a2c5-dc5b115e9a9a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295065 May 12 17:49:49.837129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 300/631] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:49:49 2022] POST /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:54.796766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1916766463", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1380938625", "security_groups": [{"name": "tempest-secgroup-smoke-948308070"}], "block_device_mapping_v2": [{"uuid": "18b373e6-f7d2-46e1-8e81-283181230a2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a25dbb6f-d15b-498d-a498-e2acebdb3c69"}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:55.004657 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] validate_networks() for [('a25dbb6f-d15b-498d-a498-e2acebdb3c69', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:49:55.359865 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:49:55.360318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:49:55.360798 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:49:55.361215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:49:55.361649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:49:55.370765 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.371217 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.372026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:55.372505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:55.389618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:49:55.393470 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for user adbaa9b8b7e2447da5eef8f32aff22a1 and project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:49:55.450202 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:49:55.452294 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18b373e6-f7d2-46e1-8e81-283181230a2c',volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:49:55.585104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c07adb5e-6fef-4b76-8462-1c5b3029e596 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.792175 May 12 17:49:55.587093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 332/632] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:49:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:49:55.596889 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c6e379e6-0b4f-425c-b4e4-e40187cebc41 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:55.597665 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c6e379e6-0b4f-425c-b4e4-e40187cebc41 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:55.657586 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c6e379e6-0b4f-425c-b4e4-e40187cebc41 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:55.664152 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c6e379e6-0b4f-425c-b4e4-e40187cebc41 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1095 microversion: 2.1 time: 0.072162 May 12 17:49:55.665214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 301/633] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:55 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:56.680643 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:56.681352 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:56.688751 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.689212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.689988 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:56.690815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:56.752187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:56.759907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8c9f7491-7681-4d9e-a117-059491a66d9d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1193 microversion: 2.1 time: 0.083450 May 12 17:49:56.760498 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 333/634] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:56 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:57.777207 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:57.778064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:57.785216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:57.785745 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:57.786587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:57.787026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:57.955031 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:57.963097 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-64a5e798-b3d2-46c9-81db-1ee95ca2d974 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1211 microversion: 2.1 time: 0.189701 May 12 17:49:57.963682 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 302/635] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:57 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:58.391151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33da2ecd-87e4-4aba-86b3-480440733bbe"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:58.393001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.402246 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.402711 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.403511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.403954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.493145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Invalid volume: volume 33da2ecd-87e4-4aba-86b3-480440733bbe is already attached to instances: a503b1e5-5436-4a5d-bea7-646c0f541e12 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: POST /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments HTTP/1.1 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 74 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:49:58.495541 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {"volumeAttachment": {"volumeId": "33da2ecd-87e4-4aba-86b3-480440733bbe"}} May 12 17:49:58.497132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Invalid volume: volume 33da2ecd-87e4-4aba-86b3-480440733bbe is already attached to instances: a503b1e5-5436-4a5d-bea7-646c0f541e12 May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'server_id': 'a503b1e5-5436-4a5d-bea7-646c0f541e12', 'body': {'volumeAttachment': {'volumeId': '33da2ecd-87e4-4aba-86b3-480440733bbe'}}} May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 33da2ecd-87e4-4aba-86b3-480440733bbe is already attached to instances: a503b1e5-5436-4a5d-bea7-646c0f541e12 May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:58.497974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 33da2ecd-87e4-4aba-86b3-480440733bbe is already attached to instances: a503b1e5-5436-4a5d-bea7-646c0f541e12 May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:49:58.499257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 33da2ecd-87e4-4aba-86b3-480440733bbe is already attached to instances: a503b1e5-5436-4a5d-bea7-646c0f541e12 May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 400 to user: Invalid volume: volume 33da2ecd-87e4-4aba-86b3-480440733bbe is already attached to instances: a503b1e5-5436-4a5d-bea7-646c0f541e12 {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e356f0cf-f644-4b60-817a-9ed89d8e51a3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110234 May 12 17:49:58.500734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 334/636] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:49:58 2022] POST /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:49:58.561149 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.561650 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.567878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.568370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.569154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.570679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.652053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lazy-loading 'services' on Instance uuid a503b1e5-5436-4a5d-bea7-646c0f541e12 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:49:58.721820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-155279f6-0464-4438-b350-71a4fe7657b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments/33da2ecd-87e4-4aba-86b3-480440733bbe" status: 202 len: 0 microversion: 2.1 time: 0.164396 May 12 17:49:58.722408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 303/637] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:49:58 2022] DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments/33da2ecd-87e4-4aba-86b3-480440733bbe => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:49:58.730598 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.731531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.740179 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.740638 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.742005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.742632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.770976 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-99a9903f-57c1-4d37-85c5-d9964309c04f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 May 12 17:49:58.771530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 335/638] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:49:58 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:58.981479 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:58.982186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:58.988154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.988635 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:58.989406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:58.989843 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:59.122109 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:49:59.129635 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6968347b-9578-40e5-bba7-f258e385ef52 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.152340 May 12 17:49:59.130205 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 304/639] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:49:58 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:49:59.433814 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-36f14620-abde-4bb0-9e35-cb00bd98b7a9 req-84a116c4-03c2-4298-bce0-cae16017c94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e314313-1f60-4a9d-b9ef-f7bebb900128", "tag": "3097e5e4-7176-4b16-b461-cbfe581f97b7"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:49:59.446727 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-36f14620-abde-4bb0-9e35-cb00bd98b7a9 req-84a116c4-03c2-4298-bce0-cae16017c94c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:59.447523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-36f14620-abde-4bb0-9e35-cb00bd98b7a9 req-84a116c4-03c2-4298-bce0-cae16017c94c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:59.459986 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-36f14620-abde-4bb0-9e35-cb00bd98b7a9 req-84a116c4-03c2-4298-bce0-cae16017c94c service nova] Creating event network-changed:3097e5e4-7176-4b16-b461-cbfe581f97b7 for instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 on hv-cinder-84052 May 12 17:49:59.465394 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-36f14620-abde-4bb0-9e35-cb00bd98b7a9 req-84a116c4-03c2-4298-bce0-cae16017c94c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036881 May 12 17:49:59.466587 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 336/640] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:49:59.782505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:49:59.783518 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:49:59.790197 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:59.790651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:59.791487 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:49:59.791925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:49:59.823664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-58874498-dac2-430e-827e-f7d64a9c41df tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 May 12 17:49:59.824303 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 305/641] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:49:59 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:00.149101 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:00.149724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:00.155888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:00.156391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.157163 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:00.157605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.295417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:00.307551 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-528298e3-fa13-4063-a88b-9b3281a2f5f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.163468 May 12 17:50:00.308257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 337/642] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:00 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:00.835517 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:00.836473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:00.842728 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:00.843173 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.843933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:00.844407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.873252 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dd375cc5-b4e6-4cfe-be0c-8af8d99514c8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042267 May 12 17:50:00.873806 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 306/643] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:50:00 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:50:00.931373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:00.931891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:00.938510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:00.938965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.939739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:00.940202 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:00.964964 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:50:01.041513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-096ca6a5-d1f4-4029-bea3-9587e0afc07e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 204 len: 0 microversion: 2.1 time: 0.113804 May 12 17:50:01.042119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 338/644] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:50:00 2022] DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:01.051335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:01.052052 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:01.058468 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.058910 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.059681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.060122 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.184507 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:01.192026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8f41cc2d-f27d-4a6e-a082-06d272bd7632 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1682 microversion: 2.1 time: 0.145567 May 12 17:50:01.192625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 307/645] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:01 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:01.324921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:01.325616 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:01.331392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.331838 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.332624 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:01.333085 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:01.462223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:01.469434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-202453e1-657d-48a1-ab9b-a915873c2fdb tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.148673 May 12 17:50:01.470009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 339/646] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:01 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:02.209281 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:02.210541 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:02.217175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:02.217641 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:02.218416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:02.218861 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:02.348195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:02.356803 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3120b1ea-3ba0-4f5e-a39b-85ef3231bca4 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1682 microversion: 2.1 time: 0.151332 May 12 17:50:02.357375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 308/647] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:02 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:02.486742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:02.487263 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:02.493796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:02.494251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:02.495024 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:02.495464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:02.627144 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:02.635154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dbc325f4-166f-4e9b-9d96-7653762900a2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.152328 May 12 17:50:02.635727 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 340/648] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:02 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:03.373815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:03.374561 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:03.381127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.382424 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.383542 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.383993 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.518228 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:03.526607 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cc6775cd-9182-4a4d-bf6b-76e17b455f8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 200 len: 1682 microversion: 2.1 time: 0.156706 May 12 17:50:03.527188 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 309/649] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:03 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:03.652763 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:03.653368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:03.659553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.660001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.660807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.661243 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.771549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-bfed9421-e644-44d6-9db2-ad9134f1445e req-fd59ae63-6ef8-434f-868b-a3e5bbd97d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a503b1e5-5436-4a5d-bea7-646c0f541e12", "name": "network-vif-deleted", "tag": "e033835a-7af5-4643-bc44-3aa48f300548"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:03.782323 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-bfed9421-e644-44d6-9db2-ad9134f1445e req-fd59ae63-6ef8-434f-868b-a3e5bbd97d89 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:03.782948 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-bfed9421-e644-44d6-9db2-ad9134f1445e req-fd59ae63-6ef8-434f-868b-a3e5bbd97d89 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:03.805236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-bfed9421-e644-44d6-9db2-ad9134f1445e req-fd59ae63-6ef8-434f-868b-a3e5bbd97d89 service nova] Creating event network-vif-deleted:e033835a-7af5-4643-bc44-3aa48f300548 for instance a503b1e5-5436-4a5d-bea7-646c0f541e12 on hv-cinder-84052 May 12 17:50:03.814334 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:03.817939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-bfed9421-e644-44d6-9db2-ad9134f1445e req-fd59ae63-6ef8-434f-868b-a3e5bbd97d89 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043571 May 12 17:50:03.818771 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 310/650] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:03.824675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4ccd4c32-123f-4b39-bbb3-d5972f7267c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.175509 May 12 17:50:03.832498 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 341/651] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:03 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:04.544041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:04.544761 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:04.551351 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:04.551797 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:04.552587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:04.553020 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:04.566793 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 HTTP/1.1 May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:50:04.568618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:50:04.570051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'a503b1e5-5436-4a5d-bea7-646c0f541e12'} May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:04.570895 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:50:04.573029 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:50:04.575501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:04.575501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b5de972d-8ca3-4d7a-9013-b723e5718f24 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 404 len: 111 microversion: 2.1 time: 0.030231 May 12 17:50:04.575501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 311/652] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:04 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:50:04.579985 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-53923b6b-507c-49e2-b38b-006fedcc3ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '.version_select at 0x7fc0c5901820>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:04.607757 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-53923b6b-507c-49e2-b38b-006fedcc3ce0 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133706448" status: 202 len: 0 microversion: 2.1 time: 0.031824 May 12 17:50:04.608368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 342/653] 10.222.0.73 () {58 vars in 1220 bytes} [Thu May 12 17:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133706448 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:04.842557 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:04.843464 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:04.851665 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:04.852243 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:04.853086 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:04.853615 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:05.032562 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:05.041181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4ed42d1c-0afc-4c08-a8b7-1fa0fc731cc7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.203478 May 12 17:50:05.041846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 312/654] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:04 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:05.519500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d24b165a-2ce9-45b2-a218-4f8607ee75d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: .version_select at 0x7fc0c591a4c0>, body: {"keypair": {"name": "tempest-keypair-171982007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAQtSCfadceu1AWYAzRdbGYdZAUUXHr0xOCZDxZCIvkMl3EyFHJ4muUabZ9kNIjdRUT0UbcDU3KNbi5Z5iLcuJWx5oJ+OosArqCvj0vP4CjwDv4KMR9RhedA/hYBjkRrQ=="}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:05.534742 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-d24b165a-2ce9-45b2-a218-4f8607ee75d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:50:05.539224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-d24b165a-2ce9-45b2-a218-4f8607ee75d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:50:05.559569 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d24b165a-2ce9-45b2-a218-4f8607ee75d7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044451 May 12 17:50:05.560139 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 343/655] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:50:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:06.058408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:06.058930 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:06.064822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:06.065277 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:06.066053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:06.066496 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:06.285646 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:06.293207 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e11d5761-0e51-4f04-b4d9-d9433798a086 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.239750 May 12 17:50:06.293783 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 313/656] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:06 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:06.890391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382288171", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1221ba24-0e4c-4509-ac6d-bff82c57688b"}], "security_groups": [{"name": "tempest-securitygroup--582870717"}], "key_name": "tempest-keypair-171982007", "user_data": "}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:06.990600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] validate_networks() for [('1221ba24-0e4c-4509-ac6d-bff82c57688b', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:50:07.309751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:07.310361 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:07.316720 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:07.317175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:07.317943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:07.318384 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:07.348818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:50:07.349587 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:50:07.350078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:50:07.350536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:50:07.351179 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:50:07.359974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:07.360478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:07.361288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:07.361764 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:07.379442 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:50:07.384320 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Getting quotas for user 1cc16878bc6a445f8a66dfcdc54a7e7b and project 0eee0523f68a4d8dbc6db8de3a3f6b04. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:50:07.395032 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:50:07.398800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:50:07.444870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b6870149-9dd9-4ea7-a7b9-805edcc4c98d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.558534 May 12 17:50:07.450704 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 344/657] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:50:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:50:07.452673 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:07.456529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2b14c395-8b53-43aa-b61e-e1f0f00d1a33 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:07.457222 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2b14c395-8b53-43aa-b61e-e1f0f00d1a33 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:07.461906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e16cf9d4-8080-4ce5-a5cb-17f6d339d5d0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.155891 May 12 17:50:07.462857 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 314/658] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:07 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:07.519919 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2b14c395-8b53-43aa-b61e-e1f0f00d1a33 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:07.527032 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2b14c395-8b53-43aa-b61e-e1f0f00d1a33 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1241 microversion: 2.1 time: 0.074711 May 12 17:50:07.527872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 345/659] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:07 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:08.478195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:08.478831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:08.485148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:08.485597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:08.486368 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:08.486811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:08.543871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:08.544651 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:08.551586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:08.552055 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:08.552923 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:08.553346 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:08.630460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:08.641224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6f0b3d2a-8169-4e50-b448-cbb212737f96 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1301 microversion: 2.1 time: 0.101055 May 12 17:50:08.642475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 346/660] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:08 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:08.666604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:08.674954 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4308fd33-68b1-4e31-9c48-f0aac6b13264 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.201287 May 12 17:50:08.686524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 315/661] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:08 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:09.659011 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:09.659676 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:09.666250 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:09.666705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:09.667488 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:09.667932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:09.691860 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:09.693146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:09.699868 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:09.700344 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:09.701319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:09.701910 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:09.859462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:09.867863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-97e1fabb-ce94-4153-b9a7-a9a77300ee75 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.212568 May 12 17:50:09.868614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 347/662] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:09 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:09.884951 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:09.892148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-11323d40-f66c-434a-888a-7be81b48af2d tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.203977 May 12 17:50:09.892760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 316/663] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:09 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:10.226692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-99e9abcf-fb23-4057-a972-2c9812a50fb9 req-903f2229-b04d-43ca-84b1-3f26dd21baf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390d5f65-8274-4983-a8fc-da556078c431", "tag": "04ab8812-f96b-40d8-949a-29d8651be151"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:10.239083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-99e9abcf-fb23-4057-a972-2c9812a50fb9 req-903f2229-b04d-43ca-84b1-3f26dd21baf7 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.239535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-99e9abcf-fb23-4057-a972-2c9812a50fb9 req-903f2229-b04d-43ca-84b1-3f26dd21baf7 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.267424 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-c10616bf-5bfb-4486-abf1-b73b895c1fa0 req-96926ffe-6079-4776-b130-5eedb9bedb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e314313-1f60-4a9d-b9ef-f7bebb900128", "name": "network-vif-plugged", "status": "completed", "tag": "3097e5e4-7176-4b16-b461-cbfe581f97b7"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:10.272908 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-99e9abcf-fb23-4057-a972-2c9812a50fb9 req-903f2229-b04d-43ca-84b1-3f26dd21baf7 service nova] Creating event network-changed:04ab8812-f96b-40d8-949a-29d8651be151 for instance 390d5f65-8274-4983-a8fc-da556078c431 on hv-cinder-84052 May 12 17:50:10.283669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-99e9abcf-fb23-4057-a972-2c9812a50fb9 req-903f2229-b04d-43ca-84b1-3f26dd21baf7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063188 May 12 17:50:10.284776 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 348/664] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:10.292634 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-c10616bf-5bfb-4486-abf1-b73b895c1fa0 req-96926ffe-6079-4776-b130-5eedb9bedb1d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.297148 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-c10616bf-5bfb-4486-abf1-b73b895c1fa0 req-96926ffe-6079-4776-b130-5eedb9bedb1d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.321663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-c10616bf-5bfb-4486-abf1-b73b895c1fa0 req-96926ffe-6079-4776-b130-5eedb9bedb1d service nova] Creating event network-vif-plugged:3097e5e4-7176-4b16-b461-cbfe581f97b7 for instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 on hv-cinder-84052 May 12 17:50:10.329214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-c10616bf-5bfb-4486-abf1-b73b895c1fa0 req-96926ffe-6079-4776-b130-5eedb9bedb1d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066013 May 12 17:50:10.329893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 317/665] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:10.886020 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.886647 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:10.893474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.893933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.894709 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.895152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.909587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:10.910286 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:10.917030 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.917487 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:10.918264 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:10.918713 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:11.087543 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:11.096308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:11.098571 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2d0f4090-c7b3-43d6-982a-61f3e84fe1b1 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.216989 May 12 17:50:11.099163 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 349/666] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:11.104630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a6c22ca9-3354-41ee-b27c-5516961e44e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.199616 May 12 17:50:11.105313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 318/667] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:10 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:12.115846 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:12.117395 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:12.121394 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:12.122011 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:12.123632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:12.124081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:12.124887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:12.125326 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:12.128156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:12.128629 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:12.129395 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:12.129828 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:12.311683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:12.318830 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-25b9d015-6736-43fa-813c-d9220afafe52 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.206793 May 12 17:50:12.319996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 350/668] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:12 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:12.324965 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:12.332375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-648ae93f-10d9-427b-9042-e8aa442c543c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1266 microversion: 2.1 time: 0.214637 May 12 17:50:12.333018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 319/669] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:12 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:13.351655 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:13.352430 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:13.358730 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.359191 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.359977 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.361083 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.391871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:13.392521 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:13.399223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.399674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.400494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.400940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.569488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:13.576486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:13.579087 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f8a523dd-53e8-46da-af11-61c1f3d335f9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1453 microversion: 2.1 time: 0.233273 May 12 17:50:13.579876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 320/670] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:13 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:13.591156 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0c1138e2-33f6-440b-8fa8-4459d6bc2197 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.259204 May 12 17:50:13.591790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 351/671] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:13 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:13.595978 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:13.596621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:13.602596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.603053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.603831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:13.604298 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:13.742488 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:13.749777 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3d9be79d-43cb-4885-b33a-722f4e3a6f6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1453 microversion: 2.1 time: 0.157696 May 12 17:50:13.750336 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 321/672] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:13 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:14.610396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:14.611025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:14.618094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:14.618544 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:14.619583 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:14.619733 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:14.825396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:14.833282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-02db5e20-8d89-4c4c-b4d7-48cedcec3488 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.228908 May 12 17:50:14.833952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 352/673] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:14 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:15.473419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-e279b36c-864a-4972-902f-b6af859e4067 req-0eedc0de-074d-4d42-af38-a2df29713de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e314313-1f60-4a9d-b9ef-f7bebb900128", "tag": "3097e5e4-7176-4b16-b461-cbfe581f97b7"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:15.481887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-e279b36c-864a-4972-902f-b6af859e4067 req-0eedc0de-074d-4d42-af38-a2df29713de7 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.482331 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-e279b36c-864a-4972-902f-b6af859e4067 req-0eedc0de-074d-4d42-af38-a2df29713de7 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:15.493729 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-e279b36c-864a-4972-902f-b6af859e4067 req-0eedc0de-074d-4d42-af38-a2df29713de7 service nova] Creating event network-changed:3097e5e4-7176-4b16-b461-cbfe581f97b7 for instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 on hv-cinder-84052 May 12 17:50:15.498604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-e279b36c-864a-4972-902f-b6af859e4067 req-0eedc0de-074d-4d42-af38-a2df29713de7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028848 May 12 17:50:15.499202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 322/674] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:15.852245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:15.852882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:15.859777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.860259 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:15.861049 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:15.861627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.003355 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:16.011044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7c77c376-1080-4d2a-adc2-6844befbaa99 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.164228 May 12 17:50:16.020149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 353/675] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:15 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:16.422370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-32c554ae-ea43-4c59-b50c-554c06a39efd req-cfab747b-c324-4687-b609-86afb654ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390d5f65-8274-4983-a8fc-da556078c431", "name": "network-vif-plugged", "status": "completed", "tag": "04ab8812-f96b-40d8-949a-29d8651be151"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:16.433352 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-32c554ae-ea43-4c59-b50c-554c06a39efd req-cfab747b-c324-4687-b609-86afb654ed36 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:16.433811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-32c554ae-ea43-4c59-b50c-554c06a39efd req-cfab747b-c324-4687-b609-86afb654ed36 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:16.447716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-32c554ae-ea43-4c59-b50c-554c06a39efd req-cfab747b-c324-4687-b609-86afb654ed36 service nova] Creating event network-vif-plugged:04ab8812-f96b-40d8-949a-29d8651be151 for instance 390d5f65-8274-4983-a8fc-da556078c431 on hv-cinder-84052 May 12 17:50:16.452972 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-32c554ae-ea43-4c59-b50c-554c06a39efd req-cfab747b-c324-4687-b609-86afb654ed36 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 May 12 17:50:16.453863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 323/676] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:17.027807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:17.028372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:17.034587 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.035038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.035805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.036272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.165293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:17.172421 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-54998249-ca2c-4712-9cf8-8effac0e8bf3 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.148546 May 12 17:50:17.172984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 354/677] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:17 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:17.966258 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:17.966845 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:17.972908 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.973358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.974127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:17.974565 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:17.999230 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-695c38f0-b8b1-44d3-9426-4edbac908c78 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/ips" status: 200 len: 152 microversion: 2.20 time: 0.134198 May 12 17:50:17.999781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 324/678] 10.222.0.73 () {60 vars in 1288 bytes} [Thu May 12 17:50:17 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/ips => generated 152 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 17:50:18.189475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:18.190800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:18.197349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:18.197802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:18.198668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:18.199196 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:18.335913 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:18.343072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-956bba19-6d85-4127-8c63-7ad4c751a7c5 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1366 microversion: 2.1 time: 0.157788 May 12 17:50:18.343863 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 355/679] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:18 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:19.360523 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:19.361159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:19.367991 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.368481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.369248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.369681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.500014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:19.507576 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4904b012-f98c-4366-a830-489f6a5c2a59 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1556 microversion: 2.1 time: 0.150828 May 12 17:50:19.508143 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 325/680] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:19 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:19.523530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:19.524120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:19.530276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.530665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.531430 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.531864 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.606769 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0fe1a1a7-e2bb-44f0-a6cd-baf3fbc3189d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087145 May 12 17:50:19.607367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 356/681] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:50:19 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:19.796767 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:19.797256 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:19.803448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.805210 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.806017 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:19.806466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:19.830837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lazy-loading 'flavor' on Instance uuid f637252f-a0d3-4c28-865d-6bebe0284c94 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:20.103538 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ec709a5-4d20-4eb4-9e07-4b0d5fac1d68 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/action" status: 202 len: 0 microversion: 2.20 time: 0.310761 May 12 17:50:20.104220 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 326/682] 10.222.0.73 () {62 vars in 1318 bytes} [Thu May 12 17:50:19 2022] POST /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:20.113562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:20.114536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:20.121813 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.122448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.123251 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.123851 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.333795 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:20.342775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:20.344213 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:20.345364 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-267eeb52-7eae-4320-b676-def7d98c12b7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.236654 May 12 17:50:20.346162 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 357/683] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:20 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:20.721964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:20.722558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:20.729407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.729865 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.730677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.731171 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.809754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lazy-loading 'services' on Instance uuid a9b5a3c0-ae83-4249-9ac3-dddc8a328712 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:20.884102 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cb5e96e0-d1cc-447f-8c6d-fe1343c32ab5 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments/1abeb1c4-27b3-4bff-aadf-444a8902f37e" status: 202 len: 0 microversion: 2.1 time: 0.166725 May 12 17:50:20.884746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 327/684] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:50:20 2022] DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments/1abeb1c4-27b3-4bff-aadf-444a8902f37e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:20.890334 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-4f6832a3-1485-456c-b0fe-784221708c6a req-7ff2c367-c92c-42ef-9a29-837b026051a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390d5f65-8274-4983-a8fc-da556078c431", "tag": "04ab8812-f96b-40d8-949a-29d8651be151"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:20.893605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:20.894750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:20.900830 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-4f6832a3-1485-456c-b0fe-784221708c6a req-7ff2c367-c92c-42ef-9a29-837b026051a9 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.901512 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-4f6832a3-1485-456c-b0fe-784221708c6a req-7ff2c367-c92c-42ef-9a29-837b026051a9 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.902275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.902804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.903636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:20.904510 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:20.914338 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-4f6832a3-1485-456c-b0fe-784221708c6a req-7ff2c367-c92c-42ef-9a29-837b026051a9 service nova] Creating event network-changed:04ab8812-f96b-40d8-949a-29d8651be151 for instance 390d5f65-8274-4983-a8fc-da556078c431 on hv-cinder-84052 May 12 17:50:20.919607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-4f6832a3-1485-456c-b0fe-784221708c6a req-7ff2c367-c92c-42ef-9a29-837b026051a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032808 May 12 17:50:20.920759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 358/685] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:20.940957 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a040ecd0-6787-4972-9b18-f01bcbceb12b tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051659 May 12 17:50:20.941527 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 328/686] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:50:20 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:21.364739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:21.365438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:21.372075 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:21.372558 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:21.373330 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:21.373770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:21.524978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:21.535451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:21.536853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:21.538227 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-567d8fe7-aec4-4478-b697-97f5a7cd4695 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.177789 May 12 17:50:21.539363 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 359/687] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:21 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:50:21.952667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:21.953640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:21.959887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:21.960374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:21.961838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:21.962410 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:21.991810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b8c5666f-8a85-4485-a082-23e0bcfdffa8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042948 May 12 17:50:21.992412 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 329/688] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:50:21 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:50:22.066365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:22.066900 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:22.073692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.074149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.074928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.075370 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.099677 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:50:22.172060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-38c8958e-8512-452c-89b9-be9a8ad5ee62 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 204 len: 0 microversion: 2.1 time: 0.109137 May 12 17:50:22.172798 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 360/689] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:50:22 2022] DELETE /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:22.181635 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:22.182258 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:22.188103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.188606 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.189381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.189825 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.317690 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:22.325677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8eebd882-e583-4ee4-aeac-f6bcb836111e tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1689 microversion: 2.1 time: 0.148536 May 12 17:50:22.326241 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 330/690] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:22 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:22.559024 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:22.559636 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:22.565431 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.565886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.566645 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:22.567080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:22.692950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:22.700652 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:22.702145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:22.703295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fc80d681-5d7e-462d-9fb1-cb65a0bb47f5 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.149442 May 12 17:50:22.703859 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 361/691] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:22 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:23.342951 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:23.343562 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:23.349880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:23.350329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:23.351090 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:23.351522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:23.476371 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:23.483776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ce1674cb-cf3c-4196-b51c-2a529893083c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1689 microversion: 2.1 time: 0.144665 May 12 17:50:23.484391 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 331/692] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:23 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1689 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:23.721344 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:23.721947 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:23.728797 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:23.729353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:23.732432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:23.732432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:23.860622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:23.868255 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:23.870003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:23.871157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e764c53d-0fe9-4177-888a-7c08cadec42e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.153699 May 12 17:50:23.871706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 362/693] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:23 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:24.500387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:24.501000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:24.507506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:24.507960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:24.508760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:24.509974 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:24.636707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:24.643907 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ee035071-1603-45a0-99c9-01f8b6e57cf8 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1689 microversion: 2.1 time: 0.147488 May 12 17:50:24.644528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 332/694] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:24 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:24.890481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:24.891048 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:24.897372 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:24.897826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:24.898597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:24.899038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:25.030022 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:25.037612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:25.039109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:25.040255 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-207773b3-5c35-4726-9eae-d1f0f1177a4c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.153817 May 12 17:50:25.040942 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 363/695] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:24 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:25.660943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:25.661567 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:25.667923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:25.668473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:25.669265 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:25.669707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:25.794167 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:25.801634 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1cafdb2f-d7e1-4cac-9aa7-b55e37d2333a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1689 microversion: 2.1 time: 0.144569 May 12 17:50:25.802406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 333/696] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:25 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1689 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:26.058676 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:26.059215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:26.065741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.066197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.066972 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.067413 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.196997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:26.204945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:26.206438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:26.207594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-daf503cb-efcf-48c2-9154-b6031f654c2f tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.153423 May 12 17:50:26.208186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 364/697] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:26 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:26.819609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:26.820787 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:26.829291 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.829775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.830552 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.830989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.881839 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-ad7373de-ce39-4bee-850d-a936e48acdea req-70115b0a-6bc9-40c3-be50-1022cc3d27b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b5a3c0-ae83-4249-9ac3-dddc8a328712", "name": "network-vif-deleted", "tag": "bb2465e3-e5fd-4ae3-9017-cb6fa37925e6"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:26.896531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-ad7373de-ce39-4bee-850d-a936e48acdea req-70115b0a-6bc9-40c3-be50-1022cc3d27b0 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:26.897187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-ad7373de-ce39-4bee-850d-a936e48acdea req-70115b0a-6bc9-40c3-be50-1022cc3d27b0 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:26.909625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-ad7373de-ce39-4bee-850d-a936e48acdea req-70115b0a-6bc9-40c3-be50-1022cc3d27b0 service nova] Creating event network-vif-deleted:bb2465e3-e5fd-4ae3-9017-cb6fa37925e6 for instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 on hv-cinder-84052 May 12 17:50:26.915102 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-ad7373de-ce39-4bee-850d-a936e48acdea req-70115b0a-6bc9-40c3-be50-1022cc3d27b0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109610 May 12 17:50:26.915716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 334/698] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:50:26.936926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:26.948535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-90836ff9-0f15-4755-b1d1-09280d6fb9ed tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 200 len: 1621 microversion: 2.1 time: 0.133541 May 12 17:50:26.958228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 365/699] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:26 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 1621 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:27.226411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:27.227114 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:27.234343 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.234789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.235570 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.236007 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.388667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:27.397105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:27.398701 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:27.399955 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cc9254ac-2614-405a-b049-811214a12e97 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.177803 May 12 17:50:27.411543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 335/700] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:27 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:27.966134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:27.966744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: a9b5a3c0-ae83-4249-9ac3-dddc8a328712] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:27.973072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.973523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.974291 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:27.974728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:27.988906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] HTTP exception thrown: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 could not be found. May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Request method failure captured: May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 HTTP/1.1 May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUempJqBkrdawMuXNw3bGhubgy7zT209G1Bw9kNOHCSoGyVqSk_JWhDZZpbuaiXR30BdGwKWbBfZiXLWF7aKv0vNq5w5HClxXzYWwsjn4NnUaRe4jnNLfpORFw2f_MVLsgh55kz6SOlGxBxFgOpCHXmodxJyhzFc3hsxLtyhwbwsyr8 May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:50:27.990589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_202db80dae2446e2b9cd1124b2925ced", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 298a13924a864f61adf6e4085e569358 May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 could not be found. May 12 17:50:27.992188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'a9b5a3c0-ae83-4249-9ac3-dddc8a328712'} May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 could not be found. May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:27.993166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 could not be found. May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 could not be found. May 12 17:50:27.994389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:27.995952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Returning 404 to user: Instance a9b5a3c0-ae83-4249-9ac3-dddc8a328712 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:27.995952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-076d80b5-8a29-4286-918c-cb1926f69e2c tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712" status: 404 len: 111 microversion: 2.1 time: 0.030453 May 12 17:50:27.995952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 366/701] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:27 2022] GET /compute/v2.1/servers/a9b5a3c0-ae83-4249-9ac3-dddc8a328712 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:28.001906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-02430123-df1c-48f1-a195-3035e7f1a01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '.version_select at 0x7fc0c60925e0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:28.020135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-02430123-df1c-48f1-a195-3035e7f1a01a tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808048432" status: 202 len: 0 microversion: 2.1 time: 0.022021 May 12 17:50:28.020736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 336/702] 10.222.0.73 () {58 vars in 1217 bytes} [Thu May 12 17:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808048432 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:50:28.419756 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:28.420417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:28.426500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:28.426957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:28.427741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:28.428204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:28.564216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:28.572039 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:28.573975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:28.575159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2fdf3735-1afd-4289-b14d-b6deb7f7957e tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.160248 May 12 17:50:28.575701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 367/703] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:28 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:29.594341 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:29.594985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:29.601549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:29.602009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:29.602785 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:29.603225 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:29.734038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:29.742433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:29.743937 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:29.745156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-de2cd1c1-6eb3-4299-9346-a9e82cc6392b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.155750 May 12 17:50:29.746237 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 337/704] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:29 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:30.764484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:30.765087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:30.771346 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.771796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:30.772595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.773037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:30.868558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:30.869150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:30.875534 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.875983 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:30.876783 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.877479 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:30.899070 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:30.904588 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:50:30.907702 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:30.909198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:30.910347 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-04793778-3e9f-4917-b0ae-43b346cbc1fc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.150399 May 12 17:50:30.910891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 368/705] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:30 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:30.977640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-853439a2-09cb-4a8e-b9ac-5b086c7d7064 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 204 len: 0 microversion: 2.1 time: 0.113058 May 12 17:50:30.978265 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 338/706] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:50:30 2022] DELETE /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:50:30.987907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:30.988547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:30.994447 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.994896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:30.996197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:30.996619 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:31.120425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:31.128234 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-648027d9-f879-4d51-8b18-7542dac82359 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1508 microversion: 2.1 time: 0.145499 May 12 17:50:31.128791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 369/707] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:30 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:50:31.929154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:31.929873 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:31.936350 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:31.936805 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:31.937576 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:31.938012 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:32.065166 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:32.072748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:32.074561 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:32.075731 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7b0ab67d-61e6-407f-8579-b626165eddbc tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.150858 May 12 17:50:32.076334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 339/708] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:31 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:50:32.145424 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:32.146026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:32.152867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:32.153417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:32.154182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:32.154612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:32.278773 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:32.285973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4b0cd8c6-f5b9-4abb-b553-2ce32dfbdec7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1508 microversion: 2.1 time: 0.144299 May 12 17:50:32.286545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 370/709] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:32 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:33.094805 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:33.095428 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:33.101712 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:33.102172 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:33.102947 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:33.103390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:33.232582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:33.240360 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:33.241863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:33.243053 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-69997ef9-3d1a-42be-b9fe-d7fc5e6bc281 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.152215 May 12 17:50:33.243615 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 340/710] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:33 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:33.302733 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:33.303359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:33.310051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:33.310495 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:33.311263 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:33.311698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:33.436353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:33.443665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e9215eaf-29a6-44e8-ac81-53c201e83b25 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1508 microversion: 2.1 time: 0.144732 May 12 17:50:33.444269 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 371/711] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:33 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:34.262637 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:34.263253 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:34.269886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.270344 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.271139 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.271615 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.302599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-7714f5b2-98b5-4521-90d0-ab9b62d63aa5 req-6c4a25ad-7ca6-4f3b-8d0b-efca653c9e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f7a42c-b14d-4050-a589-70b0eb9ff31b", "name": "network-vif-deleted", "tag": "08534155-023c-44b5-b553-dee4643d5c69"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:34.312939 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7714f5b2-98b5-4521-90d0-ab9b62d63aa5 req-6c4a25ad-7ca6-4f3b-8d0b-efca653c9e84 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.313623 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-7714f5b2-98b5-4521-90d0-ab9b62d63aa5 req-6c4a25ad-7ca6-4f3b-8d0b-efca653c9e84 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.326159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-7714f5b2-98b5-4521-90d0-ab9b62d63aa5 req-6c4a25ad-7ca6-4f3b-8d0b-efca653c9e84 service nova] Creating event network-vif-deleted:08534155-023c-44b5-b553-dee4643d5c69 for instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b on hv-cinder-84052 May 12 17:50:34.331484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-7714f5b2-98b5-4521-90d0-ab9b62d63aa5 req-6c4a25ad-7ca6-4f3b-8d0b-efca653c9e84 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 May 12 17:50:34.332683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 372/712] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:34.407544 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:34.416758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:34.418743 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:34.419985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9b5ed0ac-af8a-4b7b-8d8a-58862e4878f1 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.161960 May 12 17:50:34.420642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 341/713] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:34 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:34.460668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:34.461359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:34.468229 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.468646 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.469483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.469895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.500916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:34.501290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:34.501732 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lazy-loading 'fault' on Instance uuid e7f7a42c-b14d-4050-a589-70b0eb9ff31b {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:34.543796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:34.551076 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7141f769-c51e-44d9-ab95-ebe9d69406c7 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 200 len: 1312 microversion: 2.1 time: 0.094567 May 12 17:50:34.551633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 373/714] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:34 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:35.438194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:35.438801 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:35.445117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.445567 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.446325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.446758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.568423 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:35.569123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: e7f7a42c-b14d-4050-a589-70b0eb9ff31b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:35.576273 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.576737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.577520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.578694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:35.578973 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.592082 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:35.593859 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:35.595224 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f84cc57b-1293-4520-a084-a6b282f5f4e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.160715 May 12 17:50:35.596003 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 342/715] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:35 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:35.597533 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] HTTP exception thrown: Instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b could not be found. May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Request method failure captured: May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b HTTP/1.1 May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUempJqBkrdawMuXNw3bGhubgy7zT209G1Bw9kNOHCSoGyVqSk_JWhDZZpbuaiXR30BdGwKWbBfZiXLWF7aKv0vNq5w5HClxXzYWwsjn4NnUaRe4jnNLfpORFw2f_MVLsgh55kz6SOlGxBxFgOpCHXmodxJyhzFc3hsxLtyhwbwsyr8 May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:50:35.599622 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_202db80dae2446e2b9cd1124b2925ced", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 298a13924a864f61adf6e4085e569358 May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b could not be found. May 12 17:50:35.601021 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'e7f7a42c-b14d-4050-a589-70b0eb9ff31b'} May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b could not be found. May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:35.601779 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b could not be found. May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b could not be found. May 12 17:50:35.602989 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:35.604088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Returning 404 to user: Instance e7f7a42c-b14d-4050-a589-70b0eb9ff31b could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:35.604088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e930ea43-bf8b-488f-afd0-6d375bef41d0 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b" status: 404 len: 111 microversion: 2.1 time: 0.036621 May 12 17:50:35.604744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 374/716] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:35 2022] GET /compute/v2.1/servers/e7f7a42c-b14d-4050-a589-70b0eb9ff31b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:50:35.611463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:35.611977 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:35.618090 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.618543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.619398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.619835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.645766 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:50:35.725883 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9fd5d394-3332-41eb-825d-b1c62c89ac03 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 204 len: 0 microversion: 2.1 time: 0.118297 May 12 17:50:35.726407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 343/717] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:50:35 2022] DELETE /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:35.735572 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:35.736318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:35.742171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.742628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.743408 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:35.743853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:35.882843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:35.891115 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d86f2960-5ef9-4331-afb4-80494a9cc9c9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.159555 May 12 17:50:35.891692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 375/718] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:35 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:36.614921 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:36.615620 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:36.622527 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.623154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.624204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.624723 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.756078 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:36.764439 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:36.765929 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:36.767080 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-405fdf26-100d-4b0e-bba7-a4981fdb1ca7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1746 microversion: 2.20 time: 0.156525 May 12 17:50:36.767647 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 344/719] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:36 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:50:36.908834 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:36.909453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:36.915785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.916295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:36.917073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:36.917671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:37.041981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:37.049620 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-67e66092-8f21-41ee-8499-31f03bf1fe18 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.144659 May 12 17:50:37.050298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 376/720] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:36 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:37.786145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:37.786740 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:37.793714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:37.794164 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:37.795107 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:37.795545 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:37.923249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:37.930986 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:37.932509 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:37.934098 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ef801e27-76f6-42a9-be91-bf75d4f2e71d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1746 microversion: 2.20 time: 0.151638 May 12 17:50:37.934661 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 345/721] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:37 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:38.066591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:38.067223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:38.073469 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.073918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.074680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.075110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.202770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:38.213314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ca7dfb97-bfbf-420c-9558-2f7ba30c66ab tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1523 microversion: 2.1 time: 0.150423 May 12 17:50:38.213930 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 377/722] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:38 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:38.959578 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:38.960228 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:38.968610 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.969060 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:38.969851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:38.970369 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.101257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-2259d8e0-0411-48ce-9620-97c6f7b372f9 req-e42c0e35-a393-49fc-a434-6ff3f0e1b66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a324263-603c-4a73-b819-232273b7c0bb", "name": "network-vif-deleted", "tag": "aeff2539-2372-4118-8fd1-4b25292a34c4"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:39.111483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2259d8e0-0411-48ce-9620-97c6f7b372f9 req-e42c0e35-a393-49fc-a434-6ff3f0e1b66a service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.111932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2259d8e0-0411-48ce-9620-97c6f7b372f9 req-e42c0e35-a393-49fc-a434-6ff3f0e1b66a service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.118135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.123671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-2259d8e0-0411-48ce-9620-97c6f7b372f9 req-e42c0e35-a393-49fc-a434-6ff3f0e1b66a service nova] Creating event network-vif-deleted:aeff2539-2372-4118-8fd1-4b25292a34c4 for instance 8a324263-603c-4a73-b819-232273b7c0bb on hv-cinder-84052 May 12 17:50:39.126818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.128594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.128997 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-2259d8e0-0411-48ce-9620-97c6f7b372f9 req-e42c0e35-a393-49fc-a434-6ff3f0e1b66a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031347 May 12 17:50:39.129591 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 378/723] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:39.132408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6ee58759-1eda-43eb-bf93-ed56644a0edd tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1746 microversion: 2.20 time: 0.174054 May 12 17:50:39.133113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 346/724] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:38 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:39.231807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:39.232533 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:39.238592 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.239051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.239846 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.240310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.272264 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:39.272720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:39.273195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lazy-loading 'fault' on Instance uuid 8a324263-603c-4a73-b819-232273b7c0bb {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:50:39.314383 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a13924a864f61adf6e4085e569358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202db80dae2446e2b9cd1124b2925ced', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:39.321483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-dac4902d-d10c-4073-b798-aae7863d9df9 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 200 len: 1312 microversion: 2.1 time: 0.094451 May 12 17:50:39.322054 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 379/725] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:39 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:50:40.151147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:40.152342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:40.158668 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.159125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.159939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.160414 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.288880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.298752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.300283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:40.301808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a1e5bbb1-7b9f-4d78-aa25-3f6a3d757178 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1746 microversion: 2.20 time: 0.154411 May 12 17:50:40.302657 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 347/726] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:40 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:40.338911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:40.339576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] [instance: 8a324263-603c-4a73-b819-232273b7c0bb] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:40.345950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.346594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.347383 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.347825 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.362181 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] HTTP exception thrown: Instance 8a324263-603c-4a73-b819-232273b7c0bb could not be found. May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Request method failure captured: May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb HTTP/1.1 May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUempJqBkrdawMuXNw3bGhubgy7zT209G1Bw9kNOHCSoGyVqSk_JWhDZZpbuaiXR30BdGwKWbBfZiXLWF7aKv0vNq5w5HClxXzYWwsjn4NnUaRe4jnNLfpORFw2f_MVLsgh55kz6SOlGxBxFgOpCHXmodxJyhzFc3hsxLtyhwbwsyr8 May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:50:40.363883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/202db80dae2446e2b9cd1124b2925ced"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_202db80dae2446e2b9cd1124b2925ced", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 202db80dae2446e2b9cd1124b2925ced May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040566500 May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 298a13924a864f61adf6e4085e569358 May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040566500-project May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 8a324263-603c-4a73-b819-232273b7c0bb could not be found. May 12 17:50:40.365452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '8a324263-603c-4a73-b819-232273b7c0bb'} May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a324263-603c-4a73-b819-232273b7c0bb could not be found. May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:50:40.366187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a324263-603c-4a73-b819-232273b7c0bb could not be found. May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a324263-603c-4a73-b819-232273b7c0bb could not be found. May 12 17:50:40.367605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:50:40.370091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] Returning 404 to user: Instance 8a324263-603c-4a73-b819-232273b7c0bb could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:50:40.370091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e5a05deb-90eb-4d9f-b683-89c37753b470 tempest-ServerRescueNegativeTestJSON-1040566500 tempest-ServerRescueNegativeTestJSON-1040566500-project] 10.222.0.73 "GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb" status: 404 len: 111 microversion: 2.1 time: 0.030307 May 12 17:50:40.370091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 380/727] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:50:40 2022] GET /compute/v2.1/servers/8a324263-603c-4a73-b819-232273b7c0bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:50:40.428935 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-a71ebbbb-1866-49af-8044-1bc5a13ce7bc req-93eb9f46-2e49-4ec5-a352-5c3144222059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "name": "network-vif-plugged", "status": "completed", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:40.437750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-a71ebbbb-1866-49af-8044-1bc5a13ce7bc req-93eb9f46-2e49-4ec5-a352-5c3144222059 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:40.438407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-a71ebbbb-1866-49af-8044-1bc5a13ce7bc req-93eb9f46-2e49-4ec5-a352-5c3144222059 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:40.450333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-a71ebbbb-1866-49af-8044-1bc5a13ce7bc req-93eb9f46-2e49-4ec5-a352-5c3144222059 service nova] Creating event network-vif-plugged:21439de2-974d-41f9-905c-3ce53b19c55a for instance f637252f-a0d3-4c28-865d-6bebe0284c94 on hv-cinder-84052 May 12 17:50:40.455289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-a71ebbbb-1866-49af-8044-1bc5a13ce7bc req-93eb9f46-2e49-4ec5-a352-5c3144222059 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094741 May 12 17:50:40.455890 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 348/728] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:50:41.322806 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:41.323604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:41.329724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:41.330180 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:41.331134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:41.331609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:41.476260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:41.485066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:41.486568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:41.487936 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-21ec8e23-26f0-4a18-9844-3305eae67c28 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.168897 May 12 17:50:41.499318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 381/729] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:41 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:42.508076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:42.509416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:42.520767 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:42.521526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:42.522505 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:42.523104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:42.730699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:42.743882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:42.749443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:42.752000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f4bf945f-f546-4af4-9b03-46fc63aeb271 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.248966 May 12 17:50:42.755811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 349/730] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:42 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:43.774978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:43.774978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:43.784245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.787981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:43.789045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:43.789682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:44.048383 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:44.063076 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:44.064611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:44.066009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c66a898f-a663-4be4-8635-20c90bc1d519 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.295973 May 12 17:50:44.066770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 382/731] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:43 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:45.088515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:45.090293 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:45.101226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:45.101972 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:45.103014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:45.103767 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:45.287365 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:45.299702 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:45.303841 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:45.307760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cd1d543b-68c3-44d0-b1a9-e5ebeba8f1e6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.222283 May 12 17:50:45.309279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 350/732] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:45 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:46.327160 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:46.328843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:46.336918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:46.337459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:46.338874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:46.340402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:46.510298 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:46.524708 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:46.527380 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:46.528971 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5d4004d8-246c-46c8-8955-c22614a42d63 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.206186 May 12 17:50:46.544144 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 383/733] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:46 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:47.547865 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:47.549218 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:47.556251 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:47.556916 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:47.558675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:47.559284 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:47.712667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:47.723244 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:47.724784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:47.726318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-30afcc50-3f80-4224-af4c-970e365f702b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.182582 May 12 17:50:47.727356 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 351/734] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:47 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:48.748452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:48.749718 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:48.756677 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:48.757360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:48.758494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:48.759155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:48.913034 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:48.921688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:48.926222 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:48.927351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-36fa07a1-f677-4fb8-a084-a243753a5495 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.185268 May 12 17:50:48.927918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 384/735] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:48 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:49.945835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:49.947838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:49.955268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:49.955884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:49.956828 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:49.957562 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:50.133604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:50.143203 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:50.144858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:50.146112 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-11f849c5-e526-4c25-b2e0-7fd1260bd884 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.204350 May 12 17:50:50.158193 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 352/736] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:49 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:51.165728 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:51.166579 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:51.173939 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:51.174398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:51.175176 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:51.175619 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:51.324578 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:51.334358 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:51.335920 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:51.337274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-79657be7-623c-4b7b-9b7e-fd32e0807465 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1741 microversion: 2.20 time: 0.175782 May 12 17:50:51.348324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 385/737] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:51 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:52.359816 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:52.360551 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:52.366708 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:52.367163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:52.367931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:52.368395 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:52.496099 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:52.504589 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:52.506171 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:52.507416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1afc8961-c599-4f21-9f0a-e48fc526dc14 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1723 microversion: 2.20 time: 0.152428 May 12 17:50:52.508069 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 353/738] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:52 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:53.526900 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:53.527533 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:53.533771 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:53.534221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:53.534987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:53.535425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:53.668379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:53.676109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:53.677629 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:53.678773 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a71e432c-5adc-4392-932a-f23535832f2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1723 microversion: 2.20 time: 0.155875 May 12 17:50:53.679330 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 386/739] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:53 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:54.409090 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-e729421c-b82b-4b62-abc9-5509c139c1fb req-e54181a1-f16c-47c5-9973-df47b72ab8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "name": "network-vif-unplugged", "status": "completed", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:54.418660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-e729421c-b82b-4b62-abc9-5509c139c1fb req-e54181a1-f16c-47c5-9973-df47b72ab8c8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:54.419138 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-e729421c-b82b-4b62-abc9-5509c139c1fb req-e54181a1-f16c-47c5-9973-df47b72ab8c8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:54.429982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.compute.server_external_events [req-e729421c-b82b-4b62-abc9-5509c139c1fb req-e54181a1-f16c-47c5-9973-df47b72ab8c8 service nova] Unable to find a host for instance f637252f-a0d3-4c28-865d-6bebe0284c94. Dropping event network-vif-unplugged {{(pid=123519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 17:50:54.430859 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-e729421c-b82b-4b62-abc9-5509c139c1fb req-e54181a1-f16c-47c5-9973-df47b72ab8c8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025704 May 12 17:50:54.431438 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 354/740] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 12 17:50:54.698192 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:54.699923 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:54.706277 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:54.706727 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:54.707500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:54.707940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:54.836887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:54.845216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:54.846721 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:54.847882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bf0a0d23-cbdb-4fff-88f0-2b006a5e71b9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1666 microversion: 2.20 time: 0.153615 May 12 17:50:54.848485 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 387/741] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:54 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:54.866216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "606cc676-c7be-4c39-a082-370fc314a045"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:54.867323 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:54.873165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:54.873621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:54.874388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:54.874827 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.127157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2fd12c9d-432a-46e1-83f5-7b53326e2485 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.264788 May 12 17:50:55.127945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 355/742] 10.222.0.73 () {62 vars in 1363 bytes} [Thu May 12 17:50:54 2022] POST /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-volume_attachments => generated 188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 17:50:55.240076 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:55.240614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:55.247139 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:55.247590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.248440 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:55.248886 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.492051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aee52b6b-085e-496f-b255-ee5ac3978043 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-volume_attachments/606cc676-c7be-4c39-a082-370fc314a045" status: 202 len: 0 microversion: 2.20 time: 0.256005 May 12 17:50:55.492739 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 388/743] 10.222.0.73 () {60 vars in 1456 bytes} [Thu May 12 17:50:55 2022] DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-volume_attachments/606cc676-c7be-4c39-a082-370fc314a045 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:55.550794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:50:55.551380 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:55.557670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:55.559445 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.560257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:55.560705 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.751486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1319a096-a4d2-48c3-8398-aec935db5502 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "POST /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/action" status: 202 len: 0 microversion: 2.20 time: 0.204416 May 12 17:50:55.756026 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 356/744] 10.222.0.73 () {62 vars in 1318 bytes} [Thu May 12 17:50:55 2022] POST /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 17:50:55.761403 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:55.762159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:55.769174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:55.769623 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.770400 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:55.770834 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:55.954681 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:55.963056 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:55.964821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:55.966529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1bfbf9c0-46bb-4566-924a-171f640fde25 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1674 microversion: 2.20 time: 0.209493 May 12 17:50:55.967199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 389/745] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:55 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:56.985524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:56.986051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:56.994000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:56.994810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:56.995820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:56.996483 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:57.128760 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:57.137014 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:57.138500 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:57.139648 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4fe5a9a9-8863-4ebc-b47a-5ee644d9228d tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.158170 May 12 17:50:57.140225 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 357/746] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:56 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:58.158931 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:58.159602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:58.168895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:58.169605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:58.170619 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:58.171349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:58.384899 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:58.404028 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:58.406603 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:58.410330 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d90e25fd-ff5e-4086-a6bf-b6d686412509 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.254995 May 12 17:50:58.411620 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 390/747] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:58 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:50:59.429707 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:50:59.430549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:50:59.438479 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:59.439327 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:59.440343 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:50:59.440951 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:50:59.590569 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:59.600563 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:59.601941 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:50:59.603221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1558b8a5-1582-4787-a229-45b11a359d15 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.177382 May 12 17:50:59.615289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 358/748] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:50:59 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:00.621887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:00.622500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:00.629203 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:00.629658 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:00.630434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:00.630875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:00.794329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:00.807078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:00.809705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:00.811237 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-781cd94a-b8ca-418f-9e34-e96c38b57262 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.193872 May 12 17:51:00.822410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 391/749] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:00 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:01.833442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:01.834350 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:01.842977 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:01.843546 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:01.844563 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:01.845008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:01.981664 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:01.989405 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:01.991175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:01.992574 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-10b4fba2-7860-41eb-b9d1-fb63df35dad3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.164664 May 12 17:51:01.993248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 359/750] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:01 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:03.011600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:03.012290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:03.019411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:03.020217 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:03.021322 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:03.022230 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:03.169484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:03.178068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:03.179665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:03.180971 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-672f4681-2324-48d1-9816-43c0655c25af tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.174015 May 12 17:51:03.181735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 392/751] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:03 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:04.199636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:04.200226 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:04.206432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:04.206882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:04.207650 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:04.208092 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:04.346387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:04.354064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:04.356271 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:04.357434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b0ff90d3-9131-452f-b9d4-838054341a33 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.162046 May 12 17:51:04.358007 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 360/752] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:04 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:04.618594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:04.619880 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:04.628379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:04.629266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:04.630082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:04.630514 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:04.657976 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c1569a7e-34ba-455e-8877-7ac29a1fb80f tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/ips" status: 200 len: 150 microversion: 2.1 time: 0.046049 May 12 17:51:04.664143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 393/753] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:51:04 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:05.375457 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:05.376147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:05.383474 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:05.383971 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:05.384871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:05.385567 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:05.522425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:05.536211 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:05.537703 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:05.538879 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-893c5046-e5d5-4f2f-9df8-e66d7218d1fa tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.167433 May 12 17:51:05.539429 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 361/754] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:05 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:06.557893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:06.559968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:06.567101 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:06.567915 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:06.569153 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:06.569992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:06.723944 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:06.733290 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:06.735001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:06.736397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8d250ff7-3f0f-47a1-888d-753deac19516 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.182840 May 12 17:51:06.737452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 394/755] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:06 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:07.051875 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "167f4d44-4086-4a29-a4ca-2799fc8fa667"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:07.053074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:07.060316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:07.060774 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:07.061557 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:07.062000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:07.529314 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8817f7c5-28d1-4d81-92d3-72e003bd576a tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "POST /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481342 May 12 17:51:07.530005 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 362/756] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:51:07 2022] POST /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:07.755104 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:07.755701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:07.762414 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:07.762874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:07.763649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:07.764091 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:07.892420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:07.900018 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:07.902813 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:07.903975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-645433c0-d40b-4e4c-93e1-aa6bc23f2a22 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.153000 May 12 17:51:07.904571 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 395/757] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:07 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:08.923808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:08.924789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:08.931709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:08.932179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:08.932997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:08.933430 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:09.074419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:09.082116 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:09.083597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:09.084776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-06824651-7669-48d3-83f3-1e2904b59434 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.165673 May 12 17:51:09.085329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 363/758] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:08 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:10.102741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:10.103510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:10.110465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:10.110858 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:10.111634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:10.112075 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:10.244550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:10.255631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:10.255631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:10.255980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-19c543e5-bb7b-481f-9f94-5ae473dc8295 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.156764 May 12 17:51:10.256266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 396/759] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:10 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 17:51:11.274206 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:11.274907 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:11.282047 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:11.282509 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:11.283287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:11.283731 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:11.426636 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:11.438561 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:11.440068 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:11.441287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f892077e-b039-41cc-bc9d-7295815c9fda tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.171062 May 12 17:51:11.442007 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 364/760] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:11 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:12.459819 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:12.460492 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:12.467596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:12.468121 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:12.468906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:12.469348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:12.560668 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-a89a9315-83de-42ce-bad2-9151c7aefaf1 req-a7d6d40e-224d-42b2-860f-345c69484aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "name": "network-vif-plugged", "status": "completed", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:12.570445 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-a89a9315-83de-42ce-bad2-9151c7aefaf1 req-a7d6d40e-224d-42b2-860f-345c69484aeb service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:12.571018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-a89a9315-83de-42ce-bad2-9151c7aefaf1 req-a7d6d40e-224d-42b2-860f-345c69484aeb service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:12.590677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-a89a9315-83de-42ce-bad2-9151c7aefaf1 req-a7d6d40e-224d-42b2-860f-345c69484aeb service nova] Creating event network-vif-plugged:21439de2-974d-41f9-905c-3ce53b19c55a for instance f637252f-a0d3-4c28-865d-6bebe0284c94 on hv-cinder-84052 May 12 17:51:12.595966 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-a89a9315-83de-42ce-bad2-9151c7aefaf1 req-a7d6d40e-224d-42b2-860f-345c69484aeb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038986 May 12 17:51:12.597077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 365/761] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:51:12.600508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:12.608972 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:12.610461 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:12.611618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fe7b8942-f628-4e6d-af61-6edb493f03b3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.155692 May 12 17:51:12.612392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 397/762] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:12 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:13.630899 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:13.631597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:13.638133 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:13.638587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.639387 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:13.639824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:13.771128 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:13.778871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:13.780379 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:13.781530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c60997fd-7eeb-45f6-8c3c-0cda5995edc6 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1732 microversion: 2.20 time: 0.155690 May 12 17:51:13.782081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 366/763] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:13 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:14.799644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:14.800276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:14.806567 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:14.807014 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:14.808334 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:14.808777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:14.943378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:14.951378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:14.952897 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:14.954071 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4b715562-5da9-4060-8b57-3c1f60fd1bd4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1719 microversion: 2.20 time: 0.158310 May 12 17:51:14.954625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 398/764] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:14 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:16.165105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:16.165604 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:16.172429 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:16.172887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:16.173662 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:16.174106 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:16.251671 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lazy-loading 'services' on Instance uuid 390d5f65-8274-4983-a8fc-da556078c431 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:51:16.319621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a29e42c2-cd82-4e5d-9100-c14958427a9d tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments/167f4d44-4086-4a29-a4ca-2799fc8fa667" status: 202 len: 0 microversion: 2.1 time: 0.158234 May 12 17:51:16.320233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 367/765] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:51:16 2022] DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments/167f4d44-4086-4a29-a4ca-2799fc8fa667 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:51:16.330048 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:16.331114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:16.338217 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:16.338821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:16.339750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:16.340280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:16.371831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-997ab865-b021-49aa-8181-ba6aee6d82c9 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 May 12 17:51:16.372394 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 399/766] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:51:16 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:17.384190 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:17.385398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:17.392366 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:17.392826 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:17.393598 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:17.394040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:17.423087 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-42776c60-6698-410d-acb3-8b6f82536449 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043599 May 12 17:51:17.423651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 368/767] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:51:17 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:51:17.479038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:17.479555 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:17.485938 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:17.486387 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:17.487157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:17.487595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:17.514900 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:51:17.586483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-658feee6-e95d-48ba-94fd-76eb3e17038b tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 204 len: 0 microversion: 2.1 time: 0.110693 May 12 17:51:17.587080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 400/768] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:51:17 2022] DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:51:17.596617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:17.597243 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:17.603095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:17.603695 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:17.604846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:17.605170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:17.735431 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:17.742776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2ee0f538-7f42-47d9-9be6-39a710ae994e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1681 microversion: 2.1 time: 0.150361 May 12 17:51:17.743348 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 369/769] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:17 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:18.760266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:18.761944 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:18.768530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:18.769023 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:18.769828 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:18.770320 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:18.903871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:18.911262 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ad97487d-d54c-464d-8e4b-9cbf503a8936 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1681 microversion: 2.1 time: 0.155240 May 12 17:51:18.912044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 401/770] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:18 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:19.932024 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:19.933879 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:19.940854 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:19.941455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:19.942443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:19.942957 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:20.083322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc16878bc6a445f8a66dfcdc54a7e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee0523f68a4d8dbc6db8de3a3f6b04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:20.105037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-13fcb580-6174-4a07-a019-e18b9895a00e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 200 len: 1681 microversion: 2.1 time: 0.178234 May 12 17:51:20.105623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 370/771] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:19 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:20.382511 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-2a66c4db-ae47-42b1-8a8c-84a58ee292fb req-7de9d073-9660-4075-bf39-3c54ec7d910f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390d5f65-8274-4983-a8fc-da556078c431", "name": "network-vif-deleted", "tag": "04ab8812-f96b-40d8-949a-29d8651be151"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:51:20.399524 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2a66c4db-ae47-42b1-8a8c-84a58ee292fb req-7de9d073-9660-4075-bf39-3c54ec7d910f service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:20.400271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2a66c4db-ae47-42b1-8a8c-84a58ee292fb req-7de9d073-9660-4075-bf39-3c54ec7d910f service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:20.413677 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-2a66c4db-ae47-42b1-8a8c-84a58ee292fb req-7de9d073-9660-4075-bf39-3c54ec7d910f service nova] Creating event network-vif-deleted:04ab8812-f96b-40d8-949a-29d8651be151 for instance 390d5f65-8274-4983-a8fc-da556078c431 on hv-cinder-84052 May 12 17:51:20.420963 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-2a66c4db-ae47-42b1-8a8c-84a58ee292fb req-7de9d073-9660-4075-bf39-3c54ec7d910f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 May 12 17:51:20.423164 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 402/772] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:51:21.123140 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:21.123679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:21.132514 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:21.132973 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:21.133810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:21.134281 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:21.149714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 HTTP/1.1 May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:51:21.151524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:21.153267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '390d5f65-8274-4983-a8fc-da556078c431'} May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:21.154685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:21.155984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:21.157319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:21.157319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e15ec1c8-54bf-4862-8dfb-75f20e42ace2 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 404 len: 111 microversion: 2.1 time: 0.034356 May 12 17:51:21.157319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 371/773] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:21 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:21.163172 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3ac2a23d-8de8-4cf1-83aa-d9fe95da0ab7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '.version_select at 0x7fc0cb375670>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:21.185788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3ac2a23d-8de8-4cf1-83aa-d9fe95da0ab7 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-171982007" status: 202 len: 0 microversion: 2.1 time: 0.026824 May 12 17:51:21.186484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 403/774] 10.222.0.73 () {58 vars in 1217 bytes} [Thu May 12 17:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-171982007 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:51:22.939784 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:22.940491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:22.947171 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:22.947624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:22.949782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:22.950239 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:22.963354 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 HTTP/1.1 May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:51:22.965560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:22.967129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '390d5f65-8274-4983-a8fc-da556078c431'} May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:22.967992 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:22.969334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:22.970555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:22.970555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e84e31ff-cfda-4f0d-9572-1380f0675dc8 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 404 len: 111 microversion: 2.1 time: 0.032151 May 12 17:51:22.970555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 372/775] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:51:22 2022] DELETE /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:22.975885 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:22.976647 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 390d5f65-8274-4983-a8fc-da556078c431] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:22.983351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:22.983901 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:22.984998 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:22.985610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:23.001007 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 HTTP/1.1 May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:51:23.002653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:23.004487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '390d5f65-8274-4983-a8fc-da556078c431'} May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:23.005428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. May 12 17:51:23.006849 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:23.008384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance 390d5f65-8274-4983-a8fc-da556078c431 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:23.008384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8ac0b531-b09a-46fa-a49a-e1bfa7580f05 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431" status: 404 len: 111 microversion: 2.1 time: 0.032680 May 12 17:51:23.008384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 404/776] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:22 2022] GET /compute/v2.1/servers/390d5f65-8274-4983-a8fc-da556078c431 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:51:24.136274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:24.136876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:24.143174 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.143621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.144427 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.144868 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.160453 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 HTTP/1.1 May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:51:24.162038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.163626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'a503b1e5-5436-4a5d-bea7-646c0f541e12'} May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:24.164556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.166009 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.168035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:24.168035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6e9f4d88-0b66-40c2-b5e6-912d134b203e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 404 len: 111 microversion: 2.1 time: 0.031529 May 12 17:51:24.168035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 373/777] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:51:24 2022] DELETE /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:24.171916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:24.172559 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a503b1e5-5436-4a5d-bea7-646c0f541e12] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:24.178782 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.179236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.179999 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.180472 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.195342 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 HTTP/1.1 May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:51:24.196980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.199613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'a503b1e5-5436-4a5d-bea7-646c0f541e12'} May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:24.200613 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. May 12 17:51:24.202060 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.203453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance a503b1e5-5436-4a5d-bea7-646c0f541e12 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:24.203453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1cfae907-a004-4283-996e-483b600ff650 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12" status: 404 len: 111 microversion: 2.1 time: 0.030822 May 12 17:51:24.203453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 405/778] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:24 2022] GET /compute/v2.1/servers/a503b1e5-5436-4a5d-bea7-646c0f541e12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:24.208677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:24.209187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:24.216204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.216663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.217434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.217876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.231217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 HTTP/1.1 May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:51:24.232752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.234603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'a7d5ca9d-5ce9-496f-ae0c-1e2836506652'} May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:24.235495 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.236782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:24.238232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:24.238232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f2e37888-7095-4594-877c-14078da42071 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 404 len: 111 microversion: 2.1 time: 0.029249 May 12 17:51:24.238232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 374/779] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:51:24 2022] DELETE /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:24.243017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:24.243636 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: a7d5ca9d-5ce9-496f-ae0c-1e2836506652] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:24.250212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.250656 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.251427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:24.251870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:24.265792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 HTTP/1.1 May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:51:24.267279 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.269113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'a7d5ca9d-5ce9-496f-ae0c-1e2836506652'} May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:24.270044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. May 12 17:51:24.271454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:24.273016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance a7d5ca9d-5ce9-496f-ae0c-1e2836506652 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:24.273016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77d0a4b4-5a0d-4dde-8831-fc23bf12bc8e tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652" status: 404 len: 111 microversion: 2.1 time: 0.029505 May 12 17:51:24.273016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 406/780] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:24 2022] GET /compute/v2.1/servers/a7d5ca9d-5ce9-496f-ae0c-1e2836506652 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:25.404386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:25.404888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:25.411034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:25.411478 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:25.412268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:25.412817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:25.426789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 HTTP/1.1 May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:51:25.428639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.430040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '959c1a20-6a14-4d41-a7a4-f7eded2fc759'} May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:25.430960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.432822 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:51:25.434526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:25.434526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e61c961a-ae2a-41d5-905a-78bd6bf99570 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 404 len: 111 microversion: 2.1 time: 0.030149 May 12 17:51:25.434526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 375/781] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:51:25 2022] DELETE /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:25.439169 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:25.439792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] [instance: 959c1a20-6a14-4d41-a7a4-f7eded2fc759] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:25.446043 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:25.446490 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:25.447254 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:25.447691 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:25.461418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] HTTP exception thrown: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Request method failure captured: May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 HTTP/1.1 May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUeoNPTcZZZ33i9CrbuOD1lvWwFaW_DWXelbKPlq2iX9xpryv0v_IRBk6Tly52JRyEeVTZq3MGvg6XjcAMCrYjnb0zRT-sgKmApc3GTsYydzfSIYrm0GqZHh_1hag_JhueAdYBOwS5XU3AJBXdSTCxQYjuL5CVMzvYKuq6E3SyOhWyQ May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:51:25.462924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0eee0523f68a4d8dbc6db8de3a3f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0eee0523f68a4d8dbc6db8de3a3f6b04", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 0eee0523f68a4d8dbc6db8de3a3f6b04 May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-191145057 May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 1cc16878bc6a445f8a66dfcdc54a7e7b May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeNegativeTest-191145057-project May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.465208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '959c1a20-6a14-4d41-a7a4-f7eded2fc759'} May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:51:25.466152 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. May 12 17:51:25.467744 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:51:25.469402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] Returning 404 to user: Instance 959c1a20-6a14-4d41-a7a4-f7eded2fc759 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:51:25.469402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-eb76e633-5867-47e7-8ac5-da81e2a7bf74 tempest-AttachVolumeNegativeTest-191145057 tempest-AttachVolumeNegativeTest-191145057-project] 10.222.0.73 "GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759" status: 404 len: 111 microversion: 2.1 time: 0.029537 May 12 17:51:25.469402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 407/782] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:51:25 2022] GET /compute/v2.1/servers/959c1a20-6a14-4d41-a7a4-f7eded2fc759 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:51:56.911538 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:56.912512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:56.922858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:56.923318 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:56.924105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:56.924577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:56.963157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1659096f-57c4-438c-87f0-f8e5d5102ff7 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059734 May 12 17:51:56.964125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 376/783] 10.222.0.73 () {60 vars in 1342 bytes} [Thu May 12 17:51:56 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:51:57.027839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:57.028431 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:57.036906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:57.037599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:57.038536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:57.039160 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:57.068731 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:51:57.162170 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bdc2f132-99cc-4c5f-a221-93e9b4197835 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 204 len: 0 microversion: 2.20 time: 0.137719 May 12 17:51:57.166380 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 408/784] 10.222.0.73 () {60 vars in 1279 bytes} [Thu May 12 17:51:57 2022] DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:51:57.173524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:57.174139 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:57.181200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:57.182734 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:57.183651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:57.184189 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:57.366702 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:57.376501 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:57.377987 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:57.379592 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b6fa2c58-b45b-468b-93d0-1c5dabb5ef2c tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.211112 May 12 17:51:57.380219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 377/785] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:57 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:58.401984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:58.401984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:58.409841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:58.410304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:58.411093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:58.416426 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:58.604268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:58.618431 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:58.619940 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:58.621180 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d4ca8cea-b5e4-442c-a9d6-9e9148bd7c83 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.226118 May 12 17:51:58.621731 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 409/786] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:58 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:51:59.641008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:51:59.642342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:51:59.655825 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:59.657851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:59.658698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:51:59.659185 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:51:59.938063 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:59.949793 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:59.958173 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:51:59.959422 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d452d7aa-0b9f-495e-addf-96a5fa7f5bc9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1725 microversion: 2.20 time: 0.323611 May 12 17:51:59.959984 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 378/787] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:51:59 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:52:00.978363 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:00.979120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:00.987561 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:00.988155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:00.989229 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:00.989772 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:01.074546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:01.083824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:01.085568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a2b51125e9645dc9454042f49ff3659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb0d817bd8e4eeca5ed6229a4b5c53a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:01.089536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-40775a77-f534-445a-9308-7c337cb82e77 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 200 len: 1657 microversion: 2.20 time: 0.115665 May 12 17:52:01.090884 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 410/788] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:52:00 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 1657 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 17:52:01.489583 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-74d8b39f-4949-4ced-8acd-3ac320bfa749 req-1c3c9e94-38be-4d2f-b88f-a05a18173c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f637252f-a0d3-4c28-865d-6bebe0284c94", "name": "network-vif-deleted", "tag": "21439de2-974d-41f9-905c-3ce53b19c55a"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:01.500818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-74d8b39f-4949-4ced-8acd-3ac320bfa749 req-1c3c9e94-38be-4d2f-b88f-a05a18173c1d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:01.501492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-74d8b39f-4949-4ced-8acd-3ac320bfa749 req-1c3c9e94-38be-4d2f-b88f-a05a18173c1d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:01.518840 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-74d8b39f-4949-4ced-8acd-3ac320bfa749 req-1c3c9e94-38be-4d2f-b88f-a05a18173c1d service nova] Creating event network-vif-deleted:21439de2-974d-41f9-905c-3ce53b19c55a for instance f637252f-a0d3-4c28-865d-6bebe0284c94 on hv-cinder-84052 May 12 17:52:01.525890 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-74d8b39f-4949-4ced-8acd-3ac320bfa749 req-1c3c9e94-38be-4d2f-b88f-a05a18173c1d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041764 May 12 17:52:01.526594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 379/789] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:02.110134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:02.111751 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:02.118943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:02.119757 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:02.120834 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:02.121579 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:02.140361 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] HTTP exception thrown: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Request method failure captured: May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 HTTP/1.1 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUejmdt6rAIaAFrKJOqG7bqEez8hv2Y2C8dLWHYxIEFzg6o3B9uLf-uJoXgVbZpdN-n7mRvAOttIaD7R3dGSFxOu2iSI1hUT0Iq3jU_ghIeG2HX4FkMS5F8XCf7cyfgGh5yfwPh1JnUr_2AYXn0PGiILv0pRERPNs3tzRp5yNNnijl4 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:52:02.142420 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bdb0d817bd8e4eeca5ed6229a4b5c53a", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 7a2b51125e9645dc9454042f49ff3659 May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:02.143871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'f637252f-a0d3-4c28-865d-6bebe0284c94'} May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:02.144805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:02.146102 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:02.152906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Returning 404 to user: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:02.154958 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-598f1454-7d44-4244-84a1-7b672001984a tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 404 len: 111 microversion: 2.20 time: 0.049069 May 12 17:52:02.157963 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 411/790] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:52:02 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:52:02.165871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b1c2bbac-10bc-4bdc-8c2b-cb54aa834bf9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '.version_select at 0x7fc0c61dac10>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:02.185238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b1c2bbac-10bc-4bdc-8c2b-cb54aa834bf9 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092069408" status: 204 len: 0 microversion: 2.20 time: 0.023247 May 12 17:52:02.186408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 380/791] 10.222.0.73 () {60 vars in 1261 bytes} [Thu May 12 17:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092069408 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 17:52:04.456562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2104c5da-49c4-4ced-8288-7afda89478b8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Action: 'create', calling method: .version_select at 0x7fc0cb378d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1825969552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLbuN+/boY4vqZeO5fV5+hpbo6JfOM4evEL/faPyICNoCjqFjWIH11PkcieIb2MCCQqNfpmbbghiuao4wwiPU9TiLsy6k84mRlMLoVOtsV5jVO2SbQydm0bwYsyQW4ZA=="}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:04.470059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-2104c5da-49c4-4ced-8288-7afda89478b8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Getting quotas for project 583159e196b2438698885193ca03ef4d. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:04.473872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-2104c5da-49c4-4ced-8288-7afda89478b8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Getting quotas for user 7cee74fc982d4aa39f56c6b40de259cc and project 583159e196b2438698885193ca03ef4d. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:04.498392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2104c5da-49c4-4ced-8288-7afda89478b8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.206552 May 12 17:52:04.498949 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 412/792] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:52:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:04.508768 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:04.509432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:04.517516 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:04.517975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:04.518772 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:04.519256 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:04.538076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] HTTP exception thrown: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Request method failure captured: May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 HTTP/1.1 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUejmdt6rAIaAFrKJOqG7bqEez8hv2Y2C8dLWHYxIEFzg6o3B9uLf-uJoXgVbZpdN-n7mRvAOttIaD7R3dGSFxOu2iSI1hUT0Iq3jU_ghIeG2HX4FkMS5F8XCf7cyfgGh5yfwPh1JnUr_2AYXn0PGiILv0pRERPNs3tzRp5yNNnijl4 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:52:04.540640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bdb0d817bd8e4eeca5ed6229a4b5c53a", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 7a2b51125e9645dc9454042f49ff3659 May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.542442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'f637252f-a0d3-4c28-865d-6bebe0284c94'} May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:04.543418 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.546786 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:04.548511 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Returning 404 to user: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:04.548949 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0f554667-475a-4120-8586-794a5d70fc8b tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 404 len: 111 microversion: 2.20 time: 0.048017 May 12 17:52:04.549785 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 381/793] 10.222.0.73 () {60 vars in 1279 bytes} [Thu May 12 17:52:04 2022] DELETE /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:52:04.557683 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:04.558695 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: f637252f-a0d3-4c28-865d-6bebe0284c94] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:04.567455 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:04.567668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:04.568574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:04.569199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:04.583297 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] HTTP exception thrown: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Request method failure captured: May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 HTTP/1.1 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUejmdt6rAIaAFrKJOqG7bqEez8hv2Y2C8dLWHYxIEFzg6o3B9uLf-uJoXgVbZpdN-n7mRvAOttIaD7R3dGSFxOu2iSI1hUT0Iq3jU_ghIeG2HX4FkMS5F8XCf7cyfgGh5yfwPh1JnUr_2AYXn0PGiILv0pRERPNs3tzRp5yNNnijl4 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:52:04.584803 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bdb0d817bd8e4eeca5ed6229a4b5c53a", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 7a2b51125e9645dc9454042f49ff3659 May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.586223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'f637252f-a0d3-4c28-865d-6bebe0284c94'} May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:04.587288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. May 12 17:52:04.588843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:04.590311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Returning 404 to user: Instance f637252f-a0d3-4c28-865d-6bebe0284c94 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:04.590311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4a54cee9-369d-49d7-a79d-cbfa39396be3 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94" status: 404 len: 111 microversion: 2.20 time: 0.032482 May 12 17:52:04.590311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 413/794] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:52:04 2022] GET /compute/v2.1/servers/f637252f-a0d3-4c28-865d-6bebe0284c94 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:52:05.751284 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:05.752408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:05.771863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.772388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.773201 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.773645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.800456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] HTTP exception thrown: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Request method failure captured: May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 HTTP/1.1 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUejmdt6rAIaAFrKJOqG7bqEez8hv2Y2C8dLWHYxIEFzg6o3B9uLf-uJoXgVbZpdN-n7mRvAOttIaD7R3dGSFxOu2iSI1hUT0Iq3jU_ghIeG2HX4FkMS5F8XCf7cyfgGh5yfwPh1JnUr_2AYXn0PGiILv0pRERPNs3tzRp5yNNnijl4 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:52:05.802040 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bdb0d817bd8e4eeca5ed6229a4b5c53a", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 7a2b51125e9645dc9454042f49ff3659 May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.807419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '022cd56e-632d-4336-a6d1-4de0c1952705'} May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:05.808484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.810791 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:52:05.812325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Returning 404 to user: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:05.812325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-57784971-2ef1-46e6-8732-af79b88880b4 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 404 len: 111 microversion: 2.20 time: 0.062996 May 12 17:52:05.812325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 382/795] 10.222.0.73 () {60 vars in 1279 bytes} [Thu May 12 17:52:05 2022] DELETE /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:52:05.814293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:05.815012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] [instance: 022cd56e-632d-4336-a6d1-4de0c1952705] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:05.822766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.823225 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.824012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:05.824480 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:05.839067 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] HTTP exception thrown: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Request method failure captured: May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 HTTP/1.1 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUejmdt6rAIaAFrKJOqG7bqEez8hv2Y2C8dLWHYxIEFzg6o3B9uLf-uJoXgVbZpdN-n7mRvAOttIaD7R3dGSFxOu2iSI1hUT0Iq3jU_ghIeG2HX4FkMS5F8XCf7cyfgGh5yfwPh1JnUr_2AYXn0PGiILv0pRERPNs3tzRp5yNNnijl4 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Openstack-Nova-Api-Version: 2.20 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:52:05.840654 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/bdb0d817bd8e4eeca5ed6229a4b5c53a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_bdb0d817bd8e4eeca5ed6229a4b5c53a", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: bdb0d817bd8e4eeca5ed6229a4b5c53a May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1205167548 May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 7a2b51125e9645dc9454042f49ff3659 May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1205167548-project May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.842331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '022cd56e-632d-4336-a6d1-4de0c1952705'} May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:05.843066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. May 12 17:52:05.844325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:05.845399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] Returning 404 to user: Instance 022cd56e-632d-4336-a6d1-4de0c1952705 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:05.845399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-86a6fb96-41f0-4d45-8e85-a8ebb4c49de0 tempest-AttachVolumeShelveTestJSON-1205167548 tempest-AttachVolumeShelveTestJSON-1205167548-project] 10.222.0.73 "GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705" status: 404 len: 111 microversion: 2.20 time: 0.033404 May 12 17:52:05.845399 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 414/796] 10.222.0.73 () {60 vars in 1276 bytes} [Thu May 12 17:52:05 2022] GET /compute/v2.1/servers/022cd56e-632d-4336-a6d1-4de0c1952705 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 17:52:14.753293 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:14.754144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:14.760618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:14.761058 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:14.762021 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:14.762453 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:14.790504 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:52:14.896074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-65e9fa60-b960-4697-a9cd-e89283ce9d75 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 204 len: 0 microversion: 2.1 time: 0.146372 May 12 17:52:14.901002 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 383/797] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:52:14 2022] DELETE /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:52:14.909280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:14.910016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:14.922605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:14.923311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:14.924454 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:14.925114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:15.490539 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:15.502722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-78586b7f-b648-4817-98f4-a40339af8326 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1578 microversion: 2.1 time: 0.599384 May 12 17:52:15.515875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 415/798] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:14 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1578 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:16.521614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:16.522402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:16.528944 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:16.529680 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:16.530481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:16.530922 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:16.653970 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2cb84a9e-04f1-4614-b8cc-aeecbc136d4a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: .version_select at 0x7fc0c6236790>, body: {"keypair": {"name": "tempest-keypair-45454940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeSRUlaU6/evY2BNa3Qj8Awvaqz5ktDqxb76ufsv2B/sDZ1Hn5FeEf+s1mB6pbHenF57E1W4tSXAyaVrfDfe1oVNBh0UFySFMVFqjhmfnEnQeD0EqUgWwIYXhH8s+pYlA=="}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:16.669672 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2cb84a9e-04f1-4614-b8cc-aeecbc136d4a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:16.690361 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:16.693184 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-2cb84a9e-04f1-4614-b8cc-aeecbc136d4a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for user bc0ab664f7184cfd9bd6170e92512c48 and project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'key_pairs'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:16.698435 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4fa64406-a901-4d2b-92aa-1de836dea912 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1578 microversion: 2.1 time: 0.181323 May 12 17:52:16.699005 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 416/799] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:16 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:16.724411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2cb84a9e-04f1-4614-b8cc-aeecbc136d4a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.224748 May 12 17:52:16.725223 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 384/800] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:52:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:17.715417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:17.716853 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:17.734344 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:17.734790 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:17.742208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:17.743384 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:17.864673 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:17.876700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4c82dbf4-51e9-4f8a-85ac-d67a70538c2e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1511 microversion: 2.1 time: 0.164824 May 12 17:52:17.877618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 417/801] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:17 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:18.514077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-49c72ae6-f071-4418-986d-cb42c7ce6dc3 req-95ad88b4-06fe-4e89-92e4-623a8619f1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e314313-1f60-4a9d-b9ef-f7bebb900128", "name": "network-vif-deleted", "tag": "3097e5e4-7176-4b16-b461-cbfe581f97b7"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:18.529601 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-49c72ae6-f071-4418-986d-cb42c7ce6dc3 req-95ad88b4-06fe-4e89-92e4-623a8619f1e8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:18.530289 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-49c72ae6-f071-4418-986d-cb42c7ce6dc3 req-95ad88b4-06fe-4e89-92e4-623a8619f1e8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:18.545667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-49c72ae6-f071-4418-986d-cb42c7ce6dc3 req-95ad88b4-06fe-4e89-92e4-623a8619f1e8 service nova] Creating event network-vif-deleted:3097e5e4-7176-4b16-b461-cbfe581f97b7 for instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 on hv-cinder-84052 May 12 17:52:18.551537 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-49c72ae6-f071-4418-986d-cb42c7ce6dc3 req-95ad88b4-06fe-4e89-92e4-623a8619f1e8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051336 May 12 17:52:18.552630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 385/802] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:18.895727 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:18.896737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:18.907892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:18.925425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:18.932598 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:18.934038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:19.118038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:19.132429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-59519afc-2e43-409f-a9ee-8724489fbcfd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 200 len: 1226 microversion: 2.1 time: 0.240310 May 12 17:52:19.134906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 418/803] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:18 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:19.611176 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1340436166", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42aca28f-4d9c-47b5-9afa-e8a9049c9539"}], "security_groups": [{"name": "tempest-securitygroup--1908471427"}], "key_name": "tempest-keypair-45454940", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:19.819530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] validate_networks() for [('42aca28f-4d9c-47b5-9afa-e8a9049c9539', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:52:20.150904 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:20.151518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:20.172314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:20.172770 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:20.173805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:20.174239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:20.203047 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] HTTP exception thrown: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Request method failure captured: May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 HTTP/1.1 May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUiq1wglIc3jVEdtxjcF7Qh17_E5H2azGrYqK5-pmxd_E68dTbRvqH5oFitEFHwqRac0BZ7Z-Ry3GuecsyWR4gscZ4nFreIrSJxh1o8Pp4QDLVqjltck18x2Dx-1Ij0JSd8lR9aY7g39BXF0D-LH4lvzHaqzcKxY6paE6JoF_P4RJuk May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:52:20.204791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a4d7ebeafe8140b3b8332059258a83eb", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-TestVolumeBootPattern-1201380070 May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-TestVolumeBootPattern-1201380070-project May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: adbaa9b8b7e2447da5eef8f32aff22a1 May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-TestVolumeBootPattern-1201380070-project May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:52:20.206333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '8e314313-1f60-4a9d-b9ef-f7bebb900128'} May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:52:20.207353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:52:20.208754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:52:20.211796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Returning 404 to user: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:52:20.211796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5cc70f86-ea6a-424a-a5b6-5c4139374ee9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 404 len: 111 microversion: 2.1 time: 0.059623 May 12 17:52:20.211796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 419/804] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:20 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:52:20.331725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-881043382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1380938625", "security_groups": [{"name": "tempest-secgroup-smoke-948308070"}], "block_device_mapping_v2": [{"uuid": "18b373e6-f7d2-46e1-8e81-283181230a2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a25dbb6f-d15b-498d-a498-e2acebdb3c69"}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:20.750348 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] validate_networks() for [('a25dbb6f-d15b-498d-a498-e2acebdb3c69', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:52:21.135077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:52:21.135555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:52:21.135947 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:52:21.137079 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:52:21.138705 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:52:21.154346 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.155427 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.163622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.164524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.193376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:21.198597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for user bc0ab664f7184cfd9bd6170e92512c48 and project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:21.217601 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:52:21.232813 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:52:21.297444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-55cd9cdc-2f07-4627-9fe9-a07604a673e9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.694294 May 12 17:52:21.298427 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 386/805] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:52:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:52:21.312118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c10e0852-9811-46d4-85f2-0884e3e9dd3d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:21.312821 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c10e0852-9811-46d4-85f2-0884e3e9dd3d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:21.529077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c10e0852-9811-46d4-85f2-0884e3e9dd3d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:21.539250 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c10e0852-9811-46d4-85f2-0884e3e9dd3d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1236 microversion: 2.1 time: 0.234987 May 12 17:52:21.540402 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 387/806] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:21 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1236 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:21.770781 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:52:21.771335 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:52:21.771648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:52:21.772051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:52:21.772483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:52:21.788065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.788544 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.789351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:21.789787 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:21.832023 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:21.844634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for user adbaa9b8b7e2447da5eef8f32aff22a1 and project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:21.943106 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:52:21.945324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18b373e6-f7d2-46e1-8e81-283181230a2c',volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:52:22.219082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-085d9b98-cb72-4f50-a5d6-9eed562d75f1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.891152 May 12 17:52:22.232775 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e397773c-a809-4054-89c3-42c0138fa323 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:22.234072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e397773c-a809-4054-89c3-42c0138fa323 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:22.238703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 420/807] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:52:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:52:22.338628 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e397773c-a809-4054-89c3-42c0138fa323 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:22.346095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e397773c-a809-4054-89c3-42c0138fa323 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1094 microversion: 2.1 time: 0.117962 May 12 17:52:22.353733 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 388/808] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:22 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:22.557523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:22.558136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:22.587926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:22.592199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:22.593768 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:22.597527 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:22.726932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:22.737840 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7cbd0606-c811-406c-8641-829a7ea7151b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1288 microversion: 2.1 time: 0.184326 May 12 17:52:22.740080 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 421/809] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:22 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:23.259038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1461162203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1825969552", "security_groups": [{"name": "tempest-secgroup-smoke-159350135"}], "networks": [{"uuid": "4c9e560d-07a4-4ecb-97d5-62e31a28a50d"}], "block_device_mapping_v2": [{"uuid": "7ad1bb12-91a3-4ce3-b473-82428270cf45", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:23.371789 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:23.373474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:23.383952 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.384428 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.385216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.385653 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.448697 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] validate_networks() for [('4c9e560d-07a4-4ecb-97d5-62e31a28a50d', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:52:23.541899 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:23.552280 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b958a24d-fdaf-450b-9ce5-5b38be16f32e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1136 microversion: 2.1 time: 0.184294 May 12 17:52:23.563331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 422/810] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:23 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1136 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:23.757360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:23.758648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:23.766699 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.767535 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.768531 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:23.770088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:23.899385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:23.912439 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-85521962-265c-496d-95b3-9889c9b0c7e6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1294 microversion: 2.1 time: 0.159552 May 12 17:52:23.914274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 423/811] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:23 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:24.083871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:52:24.084365 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:52:24.084864 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:52:24.085270 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:52:24.085674 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:52:24.102594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.103618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.104602 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.105027 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.131517 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Getting quotas for project 583159e196b2438698885193ca03ef4d. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:24.135817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Getting quotas for user 7cee74fc982d4aa39f56c6b40de259cc and project 583159e196b2438698885193ca03ef4d. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:24.228491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:52:24.230478 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ad1bb12-91a3-4ce3-b473-82428270cf45',volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:52:24.484978 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7e5a9893-4de4-4b0d-9441-3a1865a40de9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.229555 May 12 17:52:24.489230 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 389/812] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:52:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:52:24.497850 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-876ec715-f0a8-4bd1-ba0d-34f49dfac16a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:24.498604 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-876ec715-f0a8-4bd1-ba0d-34f49dfac16a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:24.573086 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:24.573922 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:24.597600 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.598818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.600271 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.600861 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.639460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-876ec715-f0a8-4bd1-ba0d-34f49dfac16a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:24.646801 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-876ec715-f0a8-4bd1-ba0d-34f49dfac16a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1089 microversion: 2.1 time: 0.153638 May 12 17:52:24.647406 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 424/813] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:24 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1089 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:24.704199 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:24.711578 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e9d9d743-8706-45d6-8935-4f34b6267423 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1210 microversion: 2.1 time: 0.144595 May 12 17:52:24.712149 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 390/814] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:24 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:24.931506 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:24.932366 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:24.940600 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.941262 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:24.942238 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:24.942887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.072902 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:25.086928 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a1f7799a-d2a2-4068-b208-b384510dc9dc tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1294 microversion: 2.1 time: 0.156230 May 12 17:52:25.087809 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 425/815] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:24 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:25.663293 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:25.663952 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:25.675477 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.676475 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.677771 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.680409 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.728254 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:25.729913 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:25.744568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.745016 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:25.745799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:25.746221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:26.009750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:26.024884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f31bcf7f-5853-48ba-bdd6-4765ffc7d8cb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1187 microversion: 2.1 time: 0.365533 May 12 17:52:26.026012 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 391/816] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:25 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1187 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:26.107461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:26.107748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:26.117300 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:26.118163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:26.119372 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:26.120202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:26.167196 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:26.202590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-66c65647-32ca-4d79-aadb-75f9a3e9b5b6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.478009 May 12 17:52:26.209237 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 426/817] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:25 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:26.391939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:26.415582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-46e9dbb8-8ea9-4712-8357-bf1ce5ab46e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.313260 May 12 17:52:26.420286 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 392/818] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:26 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:27.042969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:27.045805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:27.055236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.055978 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.056966 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.057711 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.225239 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:27.226491 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:27.234311 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.234764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.245204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.245670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.405357 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:27.418824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-743816b4-ddff-49ce-b560-7711588a99f6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1272 microversion: 2.1 time: 0.377993 May 12 17:52:27.452879 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 427/819] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:27 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:27.463361 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:27.465505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:27.479920 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.482037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.485149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:27.488995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:27.508522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:27.523083 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b0ef14ef-044c-488f-9f08-6e1a3bf18743 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.301154 May 12 17:52:27.534753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 393/820] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:27 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:27.863586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:27.871281 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-94703eaa-e69c-4553-b8c4-2cfdfcd59dc5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.416303 May 12 17:52:27.876935 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 428/821] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:27 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:27.994407 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-e960e4b8-5a6a-4a3d-9777-354f5693e9cb req-f5e980df-e9b2-4142-b97c-20bc7cc830e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2dcfe1-505b-479b-adee-02927130d745", "tag": "ff249090-5209-40fd-90f9-a63ead339649"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:28.009274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-e960e4b8-5a6a-4a3d-9777-354f5693e9cb req-f5e980df-e9b2-4142-b97c-20bc7cc830e3 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.016466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-e960e4b8-5a6a-4a3d-9777-354f5693e9cb req-f5e980df-e9b2-4142-b97c-20bc7cc830e3 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.030946 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-e960e4b8-5a6a-4a3d-9777-354f5693e9cb req-f5e980df-e9b2-4142-b97c-20bc7cc830e3 service nova] Creating event network-changed:ff249090-5209-40fd-90f9-a63ead339649 for instance 3f2dcfe1-505b-479b-adee-02927130d745 on hv-cinder-84052 May 12 17:52:28.036997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-e960e4b8-5a6a-4a3d-9777-354f5693e9cb req-f5e980df-e9b2-4142-b97c-20bc7cc830e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046351 May 12 17:52:28.037942 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 394/822] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:28.440915 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:28.442418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:28.460034 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.462038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.463639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.465111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.545541 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:28.547038 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:28.556858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.557749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.558778 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.561530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.902378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:28.912375 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-248b21f2-27c0-4e64-b215-575d768081f8 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.477205 May 12 17:52:28.927303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 429/823] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:28 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:28.945242 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:28.949304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:28.969449 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.970285 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:28.971468 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:28.972130 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:29.297975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:29.311959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ef5378f1-df06-4915-8e7c-b460d2bc9c35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.773662 May 12 17:52:29.313877 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 395/824] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:28 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:29.371794 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:29.388204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-208ca78b-1db4-4496-9c30-d8889d7e62fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.458367 May 12 17:52:29.389597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 430/825] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:28 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:29.626917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-6782297d-252e-4e44-8a26-62226520346e req-e17ef05c-feaa-4fd6-b2e0-40f6264c176c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:29.642285 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6782297d-252e-4e44-8a26-62226520346e req-e17ef05c-feaa-4fd6-b2e0-40f6264c176c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:29.643165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-6782297d-252e-4e44-8a26-62226520346e req-e17ef05c-feaa-4fd6-b2e0-40f6264c176c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:29.664795 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-6782297d-252e-4e44-8a26-62226520346e req-e17ef05c-feaa-4fd6-b2e0-40f6264c176c service nova] Creating event network-changed:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:52:29.681502 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-6782297d-252e-4e44-8a26-62226520346e req-e17ef05c-feaa-4fd6-b2e0-40f6264c176c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.366064 May 12 17:52:29.682401 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 396/826] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:29.948261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:29.949475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:29.960784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:29.961908 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:29.963067 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:29.964390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:30.055441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-5529dd8e-da4d-4189-bc06-5810d46d13ff req-1f251fd1-c0fc-4795-9fe6-57b7ef79c952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788626d2-eff4-4f02-980a-685cfb86b7c4", "tag": "32313048-9cf4-4080-982e-b807bb4c51d5"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:30.069639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5529dd8e-da4d-4189-bc06-5810d46d13ff req-1f251fd1-c0fc-4795-9fe6-57b7ef79c952 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:30.076477 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5529dd8e-da4d-4189-bc06-5810d46d13ff req-1f251fd1-c0fc-4795-9fe6-57b7ef79c952 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:30.101783 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-5529dd8e-da4d-4189-bc06-5810d46d13ff req-1f251fd1-c0fc-4795-9fe6-57b7ef79c952 service nova] Creating event network-changed:32313048-9cf4-4080-982e-b807bb4c51d5 for instance 788626d2-eff4-4f02-980a-685cfb86b7c4 on hv-cinder-84052 May 12 17:52:30.116450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-5529dd8e-da4d-4189-bc06-5810d46d13ff req-1f251fd1-c0fc-4795-9fe6-57b7ef79c952 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063776 May 12 17:52:30.120746 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 397/827] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:30.149836 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:30.159197 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-606597ec-a3c3-4a79-8769-451d25d0afb6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.217902 May 12 17:52:30.170772 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 431/828] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:29 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:30.334298 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:30.335658 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:30.345133 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:30.345860 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:30.347518 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:30.348342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:30.407774 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:30.408589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:30.417669 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:30.418124 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:30.418995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:30.419475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:30.724603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:30.743325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-58f26455-53dd-4dd6-b4bb-f06d36b125bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.414882 May 12 17:52:30.744527 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 398/829] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:30 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:30.755958 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:30.764916 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-59782b5d-a274-46cb-86fb-7d5fd44bf750 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.362387 May 12 17:52:30.766017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 432/830] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:30 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:31.176834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:31.177467 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:31.183354 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:31.183798 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:31.185370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:31.185842 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:31.324278 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:31.333194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-10e1056d-1661-419e-bd1d-db79352b9084 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.160119 May 12 17:52:31.336072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 399/831] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:31 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:31.760892 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:31.761509 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:31.769400 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:31.770132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:31.770919 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:31.775959 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:31.783799 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:31.783799 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:31.795011 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:31.795493 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:31.796304 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:31.798933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:32.097912 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:32.101248 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:32.105923 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-54f26bef-1ca0-4b1c-b5f2-bf535f256281 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.348701 May 12 17:52:32.116256 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 433/832] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:31 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:32.118466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1f7730fc-df1b-4ab7-9213-9e47cfaff251 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.339860 May 12 17:52:32.123793 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 400/833] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:31 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:32.350864 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:32.351829 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:32.358395 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:32.359207 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:32.360240 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:32.360909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:32.523599 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:32.532462 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3365db1a-5f5c-4be7-9d5d-c003cabc4b75 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.185477 May 12 17:52:32.533015 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 434/834] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:32 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:33.123704 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:33.124290 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:33.135140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:33.135749 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:33.136425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.136881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.137845 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.138280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.149307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.150175 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.151239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.151909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.703661 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:33.716587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-73e750ba-714b-4490-af54-cdf763cc7d50 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.597133 May 12 17:52:33.726186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 401/835] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:33 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:33.732270 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-d201e7b5-b1fd-4b8d-b06b-5b760bc30a60 req-340f4df8-07e7-409d-a3b3-83e76a7e7389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2dcfe1-505b-479b-adee-02927130d745", "name": "network-vif-plugged", "status": "completed", "tag": "ff249090-5209-40fd-90f9-a63ead339649"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:33.741166 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d201e7b5-b1fd-4b8d-b06b-5b760bc30a60 req-340f4df8-07e7-409d-a3b3-83e76a7e7389 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.741975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d201e7b5-b1fd-4b8d-b06b-5b760bc30a60 req-340f4df8-07e7-409d-a3b3-83e76a7e7389 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.742577 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:33.759213 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-d201e7b5-b1fd-4b8d-b06b-5b760bc30a60 req-340f4df8-07e7-409d-a3b3-83e76a7e7389 service nova] Creating event network-vif-plugged:ff249090-5209-40fd-90f9-a63ead339649 for instance 3f2dcfe1-505b-479b-adee-02927130d745 on hv-cinder-84052 May 12 17:52:33.764214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-d201e7b5-b1fd-4b8d-b06b-5b760bc30a60 req-340f4df8-07e7-409d-a3b3-83e76a7e7389 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 May 12 17:52:33.764788 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 402/836] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:33.768190 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4419b98d-75c0-4523-9269-2bf8ede5d693 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.636820 May 12 17:52:33.768800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 435/837] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:33 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:33.772385 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:33.773352 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:33.784599 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.785051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.785876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:33.789017 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:33.985861 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:34.003284 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ae1938e6-06cc-4a2a-be79-e82dc2177062 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.236988 May 12 17:52:34.004321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 403/838] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:33 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:34.738335 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:34.741843 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:34.749326 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.749971 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.751245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.752157 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.785308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:34.786337 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:34.803326 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.803882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.804778 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:34.805448 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:34.986212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:34.994049 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-78e6e995-01e6-4cfa-be54-7651696f95c9 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.263865 May 12 17:52:35.009295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 436/839] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:34 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:35.020987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:35.021896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:35.031068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:35.031530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:35.032360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:35.032799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:35.040374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:35.049906 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1c1f7505-eb88-431f-ba82-639a23959b99 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1362 microversion: 2.1 time: 0.268362 May 12 17:52:35.053717 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 404/840] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:34 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:35.217576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:35.225818 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d33955fa-9aef-4b1b-9b71-dc09689d9fdd tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.208580 May 12 17:52:35.234706 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 437/841] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:35 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:36.015778 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:36.017174 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:36.030594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.031092 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.035817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.037917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.070862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:36.072640 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:36.083666 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.084413 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.090043 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.090900 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.308689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:36.317340 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-58887a1a-96bc-4d4a-9b15-4b025095d479 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.307414 May 12 17:52:36.320036 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 405/842] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:36 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:36.325657 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:36.330649 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:36.343027 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.343739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.344750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.345186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.374274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:36.385314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c928da1a-21de-4ae7-8e5a-79eb7ce458d3 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1548 microversion: 2.1 time: 0.318964 May 12 17:52:36.397239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 438/843] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:36 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1548 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:36.405802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:36.406570 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:36.413204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.413871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.414815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:36.416189 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:36.545174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-150c4cf0-58be-4433-8639-98f2ff8fb906 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144715 May 12 17:52:36.551223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 439/844] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:52:36 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:36.608455 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:36.626763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ef8ae908-427b-4fad-b2fd-be714a22882f tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.305446 May 12 17:52:36.630238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 406/845] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:36 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:37.338324 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:37.339508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:37.346609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:37.347436 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:37.348458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:37.349050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:37.543297 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:37.554360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-31d4e531-e78e-45f1-a0ca-9a515aa12e35 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.221237 May 12 17:52:37.556799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 440/846] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:37 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:37.651409 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:37.652733 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:37.662374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:37.662825 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:37.663687 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:37.664197 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:37.888398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:37.898080 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5bea2443-fe24-4332-bf46-7f3a2d61554a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.255327 May 12 17:52:37.899156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 407/847] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:37 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:38.117569 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-f5f73b57-ce65-4be2-a5e4-41549d5548a1 req-4fdea109-3415-4ce4-8701-8f42dc4f1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f2dcfe1-505b-479b-adee-02927130d745", "tag": "ff249090-5209-40fd-90f9-a63ead339649"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:38.134345 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f5f73b57-ce65-4be2-a5e4-41549d5548a1 req-4fdea109-3415-4ce4-8701-8f42dc4f1bf6 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.135260 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-f5f73b57-ce65-4be2-a5e4-41549d5548a1 req-4fdea109-3415-4ce4-8701-8f42dc4f1bf6 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.154875 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-f5f73b57-ce65-4be2-a5e4-41549d5548a1 req-4fdea109-3415-4ce4-8701-8f42dc4f1bf6 service nova] Creating event network-changed:ff249090-5209-40fd-90f9-a63ead339649 for instance 3f2dcfe1-505b-479b-adee-02927130d745 on hv-cinder-84052 May 12 17:52:38.162504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-f5f73b57-ce65-4be2-a5e4-41549d5548a1 req-4fdea109-3415-4ce4-8701-8f42dc4f1bf6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051141 May 12 17:52:38.162504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 441/848] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:38.574469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:38.575954 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:38.583045 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.583759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.584995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.585585 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.753619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:38.771756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2704a4b7-c138-414f-bd49-2956ce0625c1 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.201871 May 12 17:52:38.773010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 408/849] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:38 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:38.923523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:38.924250 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:38.936667 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.940979 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:38.942066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:38.942679 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:39.157011 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:39.164839 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aee10107-611b-415a-b244-50fb3ed3d97c tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.246541 May 12 17:52:39.166515 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 442/850] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:38 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:39.790405 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:39.791046 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:39.798229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:39.798681 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:39.799667 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:39.800299 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:39.968763 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:39.978207 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6d378f74-0c87-4fa7-8c92-ddbb4c0505cd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.191768 May 12 17:52:39.978821 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 409/851] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:39 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:40.183508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:40.184107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:40.196130 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:40.204219 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:40.205673 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:40.207584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:40.408444 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:40.417217 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d941f8d8-afd8-40e1-a588-41a97c9d3052 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.237281 May 12 17:52:40.418334 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 443/852] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:40 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:40.995118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:40.995753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:41.002543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:41.003067 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:41.003935 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:41.004744 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:41.176714 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:41.185114 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6f88435f-55ed-4900-9b48-5025b5cd8b95 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.193552 May 12 17:52:41.185892 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 410/853] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:40 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:41.435331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:41.437379 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:41.446616 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:41.447443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:41.448354 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:41.449002 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:41.607443 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-06e7a71b-2117-4e91-8435-b51bef3b8df7 req-0576e44e-92b7-4659-ab5b-e25aab38f88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "name": "network-vif-plugged", "status": "completed", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:41.631993 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-06e7a71b-2117-4e91-8435-b51bef3b8df7 req-0576e44e-92b7-4659-ab5b-e25aab38f88d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:41.632481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-06e7a71b-2117-4e91-8435-b51bef3b8df7 req-0576e44e-92b7-4659-ab5b-e25aab38f88d service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:41.643646 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:41.651466 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b2a6ede4-42d8-4b9e-b174-be4d31cad88d tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.220802 May 12 17:52:41.660547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 444/854] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:41 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:41.671425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-06e7a71b-2117-4e91-8435-b51bef3b8df7 req-0576e44e-92b7-4659-ab5b-e25aab38f88d service nova] Creating event network-vif-plugged:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:52:41.676544 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-06e7a71b-2117-4e91-8435-b51bef3b8df7 req-0576e44e-92b7-4659-ab5b-e25aab38f88d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073727 May 12 17:52:41.677698 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 411/855] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:42.204105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:42.205017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:42.215584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:42.216647 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:42.217641 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:42.218081 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:42.367282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:42.377112 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7f9bf954-dbc7-4fde-a116-32d077a7870e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.177403 May 12 17:52:42.377872 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 445/856] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:42 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:42.670469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:42.671176 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:42.679706 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:42.680185 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:42.680997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:42.681444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:42.826159 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:42.833710 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-be841041-652c-40a5-99f1-9c6de0224925 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1260 microversion: 2.1 time: 0.168652 May 12 17:52:42.834508 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 412/857] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:42 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:43.394507 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:43.395112 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:43.401512 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:43.402195 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:43.404590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:43.405216 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:43.572376 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:43.582297 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5727f036-fc0d-4228-9e71-caad2e115fed tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.191484 May 12 17:52:43.586322 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 446/858] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:43 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:43.696202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-7282acab-ea86-44ad-a4e8-46a2dae408ad req-85187644-09e6-45c8-97c5-29a9617ebffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788626d2-eff4-4f02-980a-685cfb86b7c4", "name": "network-vif-plugged", "status": "completed", "tag": "32313048-9cf4-4080-982e-b807bb4c51d5"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:43.708416 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-7282acab-ea86-44ad-a4e8-46a2dae408ad req-85187644-09e6-45c8-97c5-29a9617ebffc service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:43.708951 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-7282acab-ea86-44ad-a4e8-46a2dae408ad req-85187644-09e6-45c8-97c5-29a9617ebffc service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:43.734081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-7282acab-ea86-44ad-a4e8-46a2dae408ad req-85187644-09e6-45c8-97c5-29a9617ebffc service nova] Creating event network-vif-plugged:32313048-9cf4-4080-982e-b807bb4c51d5 for instance 788626d2-eff4-4f02-980a-685cfb86b7c4 on hv-cinder-84052 May 12 17:52:43.740571 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-7282acab-ea86-44ad-a4e8-46a2dae408ad req-85187644-09e6-45c8-97c5-29a9617ebffc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049701 May 12 17:52:43.743869 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 413/859] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:43.850475 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:43.851625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:43.858635 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:43.859095 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:43.859885 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:43.874237 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:44.034154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:44.042390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-877ac5fd-3fb6-466b-b461-c9cf15c9bc6a tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1445 microversion: 2.1 time: 0.195696 May 12 17:52:44.054063 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 447/860] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:43 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1445 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:44.060313 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:44.061019 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:44.067478 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:44.067931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:44.068917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:44.069549 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:44.221110 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:44.229077 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c7399f97-8815-4c59-80ad-410d52940969 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1445 microversion: 2.1 time: 0.172976 May 12 17:52:44.229655 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 414/861] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:44 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:44.319657 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1fc62e1c-2287-474a-9ac3-a72cb1bb68aa tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Action: 'create', calling method: .version_select at 0x7fc0cb329940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-484908177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcqACI1XXfNHbsmTK3P/nb4JRk90BJGsh2NJ9fNCo4W75ka4l2p23PpWqKVEQ3pB+O4WQR2jvGdJERFCfSewWBu4pPNSObobrrTr8z+wbN1LJpKzmsTObDAu9weT6Ldug=="}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:44.334067 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-1fc62e1c-2287-474a-9ac3-a72cb1bb68aa tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Getting quotas for project 22f9cad467614c16acb967c11da20d7f. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:44.337741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-1fc62e1c-2287-474a-9ac3-a72cb1bb68aa tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Getting quotas for user 9c6f9b63000c47628980c8b435f12043 and project 22f9cad467614c16acb967c11da20d7f. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:44.359362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1fc62e1c-2287-474a-9ac3-a72cb1bb68aa tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.043547 May 12 17:52:44.359962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 448/862] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:52:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:44.407247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-721772252", "imageRef": "80d95933-49bb-42fa-b08d-2943254d7154", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-484908177", "networks": [{"uuid": "d316737e-c775-43a3-a667-c27cc0941735"}]}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:44.457869 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] validate_networks() for [('d316737e-c775-43a3-a667-c27cc0941735', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:52:44.600174 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:44.600809 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:44.607293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:44.607752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:44.608574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:44.609023 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:44.868329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:44.876629 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-05b0cded-5c1a-45bd-be64-6c92159336bf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1265 microversion: 2.1 time: 0.280150 May 12 17:52:44.877309 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 449/863] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:44 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:45.174934 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:52:45.175570 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:52:45.176213 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:52:45.176622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:52:45.177110 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:52:45.186758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:45.187202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:45.188033 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:45.188460 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:45.213176 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Getting quotas for project 22f9cad467614c16acb967c11da20d7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:52:45.217082 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Getting quotas for user 9c6f9b63000c47628980c8b435f12043 and project 22f9cad467614c16acb967c11da20d7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:52:45.227955 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:52:45.230182 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80d95933-49bb-42fa-b08d-2943254d7154',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:52:45.277215 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8ecf9c9b-b3fc-4820-8cb7-b3ae6991f6ee tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874412 May 12 17:52:45.282881 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 415/864] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:52:45.287844 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9d00d5ae-2f2c-4e69-8784-aed2e9d89728 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:45.288505 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9d00d5ae-2f2c-4e69-8784-aed2e9d89728 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:45.364644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9d00d5ae-2f2c-4e69-8784-aed2e9d89728 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:45.376987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9d00d5ae-2f2c-4e69-8784-aed2e9d89728 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1257 microversion: 2.1 time: 0.088189 May 12 17:52:45.377725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 450/865] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:45 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1257 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:52:45.894336 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:45.895436 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:45.905119 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:45.905568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:45.906349 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:45.906792 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:46.145709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:46.153617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5b8e0c93-e281-42fa-9786-8164f102aa80 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1452 microversion: 2.1 time: 0.263190 May 12 17:52:46.154200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 416/866] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:45 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1452 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:46.170517 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:46.171162 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:46.177938 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:46.178396 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:46.179207 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:46.179648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:46.394874 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:46.395594 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:46.397682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:46.405117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:46.405566 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:46.408642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:46.410990 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:46.412792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c6e3ee55-b748-4079-9f83-0fe5facc5819 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1452 microversion: 2.1 time: 0.247169 May 12 17:52:46.425086 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 451/867] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:46 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:46.496358 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:46.504679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-051c058e-8888-4902-9659-30783d0d9eba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1327 microversion: 2.1 time: 0.113780 May 12 17:52:46.505599 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 417/868] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:46 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:46.693106 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-52fc46ee-6ff6-4a50-86b1-87e19a0c0411 req-c9ff45a7-d207-4182-956e-ac6574f28c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:46.703083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-52fc46ee-6ff6-4a50-86b1-87e19a0c0411 req-c9ff45a7-d207-4182-956e-ac6574f28c63 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:46.703712 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-52fc46ee-6ff6-4a50-86b1-87e19a0c0411 req-c9ff45a7-d207-4182-956e-ac6574f28c63 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:46.716425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-52fc46ee-6ff6-4a50-86b1-87e19a0c0411 req-c9ff45a7-d207-4182-956e-ac6574f28c63 service nova] Creating event network-changed:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:52:46.722182 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-52fc46ee-6ff6-4a50-86b1-87e19a0c0411 req-c9ff45a7-d207-4182-956e-ac6574f28c63 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032603 May 12 17:52:46.723476 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 452/869] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:47.522695 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:47.523931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:47.530762 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:47.531819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:47.533016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:47.533619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:47.845376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:47.856334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1baa4838-b4cc-455c-b8f8-54330e0de759 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.338030 May 12 17:52:47.867236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 418/870] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:47 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:48.880971 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:48.882153 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:48.915800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:48.916276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:48.917113 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:48.917553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:49.101107 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:49.110529 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e1e6b484-8881-4336-ad17-ee4ec8b96a70 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.237595 May 12 17:52:49.111378 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 453/871] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:48 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:49.466374 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-cab47fa2-93c5-4fea-8695-1eae724671cc req-0cd4cea4-3fc2-441f-b107-5f3681357261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788626d2-eff4-4f02-980a-685cfb86b7c4", "tag": "32313048-9cf4-4080-982e-b807bb4c51d5"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:49.475832 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-cab47fa2-93c5-4fea-8695-1eae724671cc req-0cd4cea4-3fc2-441f-b107-5f3681357261 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:49.476605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-cab47fa2-93c5-4fea-8695-1eae724671cc req-0cd4cea4-3fc2-441f-b107-5f3681357261 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:49.489931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-cab47fa2-93c5-4fea-8695-1eae724671cc req-0cd4cea4-3fc2-441f-b107-5f3681357261 service nova] Creating event network-changed:32313048-9cf4-4080-982e-b807bb4c51d5 for instance 788626d2-eff4-4f02-980a-685cfb86b7c4 on hv-cinder-84052 May 12 17:52:49.495835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-cab47fa2-93c5-4fea-8695-1eae724671cc req-0cd4cea4-3fc2-441f-b107-5f3681357261 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033370 May 12 17:52:49.499971 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 419/872] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:52:50.128136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:50.128703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:50.135506 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:50.135965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:50.136784 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:50.137724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:50.316617 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:50.326452 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6e05015d-2f92-4fb6-bec7-b2232044c312 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.201498 May 12 17:52:50.327045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 454/873] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:50 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:51.344032 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:51.344780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:51.350911 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:51.351364 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:51.352146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:51.352608 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:51.495234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:51.502816 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bc887389-33af-4b5c-97a7-11f05d4c37c6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.163695 May 12 17:52:51.503430 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 420/874] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:51 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:52.518981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:52.519609 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:52.525891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:52.526349 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:52.527123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:52.527565 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:52.675329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:52.683046 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-986bd4ab-a278-434b-9a01-06a2c7ec2aba tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.167908 May 12 17:52:52.692311 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 455/875] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:52 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:53.701161 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:53.702482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:53.709812 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:53.710677 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:53.711912 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:53.712551 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:53.852629 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:53.860662 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-397b1d92-0d19-4109-8640-a57bb12648a5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.164426 May 12 17:52:53.861240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 421/876] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:53 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:54.878129 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:54.878729 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:54.885151 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:54.885598 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:54.886368 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:54.886805 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:55.012881 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:55.020042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7a47e39c-1418-4517-a557-81998d603281 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.145872 May 12 17:52:55.020645 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 456/877] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:54 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:56.036744 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:56.037363 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:56.044593 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:56.045050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:56.045882 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:56.046252 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:56.177452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:56.185390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-92c180c1-cc8f-4699-9f4a-4e4ae046e618 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.152560 May 12 17:52:56.185964 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 422/878] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:56 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:56.542826 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-94e4645c-afce-4580-8020-6db7a479dbb9 req-6af65be2-82a1-4074-9e6c-789323a7b28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:52:56.552856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-94e4645c-afce-4580-8020-6db7a479dbb9 req-6af65be2-82a1-4074-9e6c-789323a7b28e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:56.553611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-94e4645c-afce-4580-8020-6db7a479dbb9 req-6af65be2-82a1-4074-9e6c-789323a7b28e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:56.567064 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-94e4645c-afce-4580-8020-6db7a479dbb9 req-6af65be2-82a1-4074-9e6c-789323a7b28e service nova] Creating event network-changed:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:52:56.572199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-94e4645c-afce-4580-8020-6db7a479dbb9 req-6af65be2-82a1-4074-9e6c-789323a7b28e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032887 May 12 17:52:56.572808 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 457/879] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:52:57.202817 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:57.203439 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:57.209831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:57.210282 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:57.211087 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:57.211555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:57.341876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:57.349514 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0bba936d-f64b-4b2c-a941-1c980d99e3d8 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.151374 May 12 17:52:57.350092 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 423/880] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:57 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:58.367650 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:58.368407 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:58.374930 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:58.375387 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:58.376186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:58.376640 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:58.514114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:58.521545 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1510bee4-6ba9-4574-97ac-1f4b39f81b61 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.158650 May 12 17:52:58.522056 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 458/881] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:58 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:52:59.538651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:52:59.539263 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:52:59.546373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:59.546819 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:59.547591 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:52:59.548028 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:52:59.678926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:52:59.687327 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ba4ae3c-a6a2-42bf-8d55-4cfdfc51fd9e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.152431 May 12 17:52:59.687905 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 424/882] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:52:59 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:00.705031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:00.705692 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:00.712275 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:00.712729 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:00.713509 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:00.713943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:00.841576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:00.848799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c27476eb-d423-46c2-bae5-979499d051ea tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.149149 May 12 17:53:00.849374 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 459/883] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:00 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:01.200734 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-d2cfefe2-81b3-4fb8-af72-a2292fe6384b req-e9a802ce-5d40-48b0-9ad8-b4dc411c1c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "name": "network-vif-plugged", "status": "completed", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:01.209556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d2cfefe2-81b3-4fb8-af72-a2292fe6384b req-e9a802ce-5d40-48b0-9ad8-b4dc411c1c42 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:01.209998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-d2cfefe2-81b3-4fb8-af72-a2292fe6384b req-e9a802ce-5d40-48b0-9ad8-b4dc411c1c42 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:01.221322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-d2cfefe2-81b3-4fb8-af72-a2292fe6384b req-e9a802ce-5d40-48b0-9ad8-b4dc411c1c42 service nova] Creating event network-vif-plugged:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:53:01.226135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-d2cfefe2-81b3-4fb8-af72-a2292fe6384b req-e9a802ce-5d40-48b0-9ad8-b4dc411c1c42 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030084 May 12 17:53:01.226738 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 425/884] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:01.865518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:01.866054 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:01.872513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:01.872960 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:01.873724 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:01.874154 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:02.000027 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:02.007402 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cee6af90-ef3b-4122-9c60-817de4563298 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.145760 May 12 17:53:02.007968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 460/885] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:01 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:03.030808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:03.031945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:03.038299 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:03.038747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:03.039508 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:03.039942 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:03.170543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:03.178699 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-21330dce-9ccd-4ce6-a76b-6583f34044da tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1357 microversion: 2.1 time: 0.156680 May 12 17:53:03.179370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 426/886] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:03 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:04.196316 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:04.196924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:04.203915 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.204501 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.205274 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.205705 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.343047 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:04.350592 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8eb5a975-ec05-4cf3-9e33-11e0fe90c55a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1547 microversion: 2.1 time: 0.158071 May 12 17:53:04.351172 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 461/887] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:04 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:04.366297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:04.366909 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:04.373442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.373891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.374649 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.375084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.503126 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:04.510627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dc448351-6fd4-4377-9e18-b8ec59d421f4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1547 microversion: 2.1 time: 0.148112 May 12 17:53:04.511194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 427/888] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:04 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:04.526413 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:04.530612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:04.531360 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Searching by: {'deleted': False, 'project_id': '22f9cad467614c16acb967c11da20d7f'} {{(pid=123520) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 17:53:04.537701 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.538143 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.538930 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.539355 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.627935 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.multi_cell_list [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 17:53:04.723921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d8eff230-384a-4158-97f9-17788dcd3d1a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201047 May 12 17:53:04.724648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 462/889] 10.222.0.73 () {58 vars in 1124 bytes} [Thu May 12 17:53:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:04.735033 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:04.735652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:04.741485 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.741943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.742715 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:04.743169 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:04.870290 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:04.878587 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-47381e55-a824-4795-ba3d-867399b8b79f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1547 microversion: 2.1 time: 0.147956 May 12 17:53:04.879162 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 428/890] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:04 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:06.380641 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc40b59b-58ae-4a4d-9940-25b5c33a919d"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:06.381821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:06.389189 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:06.389644 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:06.390418 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:06.390860 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:06.654365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4eff2c5c-a9df-4280-bca0-b7249a6781e4 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277822 May 12 17:53:06.655008 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 463/891] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:53:06 2022] POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:14.179323 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:14.179944 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:14.186712 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:14.187165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:14.187939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:14.188433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:14.313384 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:14.321218 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a7dbd126-3b1c-45c9-8172-2332e5f1c05f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1593 microversion: 2.1 time: 0.145523 May 12 17:53:14.321799 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 429/892] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:14 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1593 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:15.994658 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-641fe4c6-089c-4396-828d-4a392bf64d1e req-845903da-1208-4082-9a76-ac31db94387b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:16.003883 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-641fe4c6-089c-4396-828d-4a392bf64d1e req-845903da-1208-4082-9a76-ac31db94387b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:16.004371 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-641fe4c6-089c-4396-828d-4a392bf64d1e req-845903da-1208-4082-9a76-ac31db94387b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:16.019059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-641fe4c6-089c-4396-828d-4a392bf64d1e req-845903da-1208-4082-9a76-ac31db94387b service nova] Creating event network-changed:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:53:16.024553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-641fe4c6-089c-4396-828d-4a392bf64d1e req-845903da-1208-4082-9a76-ac31db94387b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034662 May 12 17:53:16.025682 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 464/893] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:17.292314 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-72850202"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:17.292887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:17.300050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:17.300544 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:17.301323 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:17.301768 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:17.424406 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.network.security_group_api [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Adding security group 42d35ccf-3e40-401e-b904-903627502614 to port d261cc65-c224-4075-af4c-05eb1e85cf9b May 12 17:53:17.810175 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-57afa9d5-eef0-45e2-a528-3c283fdc9a0b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/action" status: 202 len: 0 microversion: 2.1 time: 0.520604 May 12 17:53:17.811805 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 430/894] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:53:17 2022] POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:53:17.820929 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:17.821700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:17.828484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:17.828941 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:17.829717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:17.830155 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:17.990707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:18.000980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e3a0bcc6-6e0f-45c4-9baf-c7705cfb0e05 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1757 microversion: 2.1 time: 0.184487 May 12 17:53:18.009065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 465/895] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:17 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:18.039754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-3a2763b1-7a95-470d-af5b-5117231331a7 req-bc908f54-edf8-4e78-bd3f-8c0cf1cc53f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:18.048095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-3a2763b1-7a95-470d-af5b-5117231331a7 req-bc908f54-edf8-4e78-bd3f-8c0cf1cc53f6 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:18.048576 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-3a2763b1-7a95-470d-af5b-5117231331a7 req-bc908f54-edf8-4e78-bd3f-8c0cf1cc53f6 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:18.059867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-3a2763b1-7a95-470d-af5b-5117231331a7 req-bc908f54-edf8-4e78-bd3f-8c0cf1cc53f6 service nova] Creating event network-changed:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:53:18.065263 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-3a2763b1-7a95-470d-af5b-5117231331a7 req-bc908f54-edf8-4e78-bd3f-8c0cf1cc53f6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029021 May 12 17:53:18.066023 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 431/896] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:20.596648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:20.597228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:20.603434 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:20.603887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:20.604695 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:20.605140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:20.628490 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ece7e312-b438-49de-8ede-65963435067b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/ips" status: 200 len: 146 microversion: 2.1 time: 0.035583 May 12 17:53:20.629061 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 466/897] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:53:20 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:23.007163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b7b4b7c-ba8a-4d66-9866-b7d38f845474"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:23.008362 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:23.015000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:23.015450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:23.016260 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:23.016690 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:23.269820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e3ef0e94-b821-438b-86d5-fb145063a87f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267518 May 12 17:53:23.273744 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 432/898] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:53:23 2022] POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:53:30.744206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-97ad591c-5865-458f-85b0-f80736e58bfd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:30.750759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97ad591c-5865-458f-85b0-f80736e58bfd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:30.751214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-97ad591c-5865-458f-85b0-f80736e58bfd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:30.809637 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-97ad591c-5865-458f-85b0-f80736e58bfd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Going to try to stop instance {{(pid=123520) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 17:53:30.853119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-97ad591c-5865-458f-85b0-f80736e58bfd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action" status: 202 len: 0 microversion: 2.1 time: 0.112572 May 12 17:53:30.853757 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 467/899] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:53:30 2022] POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:53:30.862483 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:30.863188 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:30.869876 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:30.870292 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:30.871044 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:30.871480 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:31.004523 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:31.013618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a720b97b-7a74-4785-94aa-fb1b8dc2210c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.155286 May 12 17:53:31.014216 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 433/900] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:30 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:32.031851 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:32.032566 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:32.038592 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:32.039037 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:32.039793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:32.040252 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:32.173507 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:32.181086 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1ae20655-f848-4841-bd11-a1a860a8fb12 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.153949 May 12 17:53:32.181648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 468/901] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:32 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:33.198788 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:33.199515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:33.205789 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:33.206241 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:33.207035 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:33.207475 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:33.335145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:33.343411 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f93b92fa-1323-40b7-9e0e-5b46161b0449 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.148463 May 12 17:53:33.343976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 434/902] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:33 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:34.360227 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:34.360845 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:34.367354 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:34.367807 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:34.368611 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:34.369087 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:34.499747 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:34.507659 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2065e71a-5eb7-46a7-a38d-61d965867c88 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.151440 May 12 17:53:34.508246 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 469/903] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:34 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:35.526463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:35.527081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:35.533965 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:35.534419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:35.535197 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:35.535645 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:35.663773 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:35.671663 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8984ffaf-d2c0-44e6-8b5b-852359bf9f48 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.149102 May 12 17:53:35.672249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 435/904] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:35 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:36.689797 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:36.690422 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:36.696838 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:36.697317 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:36.698094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:36.698539 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:36.823392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:36.831177 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f72c140a-052d-4697-b42c-89ce4ed1e467 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.145904 May 12 17:53:36.831741 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 470/905] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:36 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:53:37.847713 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:37.848388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:37.854811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:37.855925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:37.856739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:37.857234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:37.986490 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:37.994239 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-91a25fac-2269-4886-a7b2-b52ff1719754 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.150515 May 12 17:53:37.994811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 436/906] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:37 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:39.010974 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:39.011690 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:39.018277 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:39.018733 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:39.019507 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:39.019968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:39.147421 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:39.155645 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f9fb32c7-c5be-46c2-a53d-92f106b1906d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.148512 May 12 17:53:39.156219 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 471/907] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:39 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:40.173439 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:40.174045 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:40.180476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:40.180924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:40.181692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:40.182371 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:40.319543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:40.328824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8061d882-569f-4deb-bce1-f4ad112a5d7a tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.159207 May 12 17:53:40.329546 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 437/908] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:40 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:53:41.345970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:41.346585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:41.353044 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:41.353499 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:41.354272 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:41.354734 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:41.482835 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:41.490481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6b3646e5-a22c-461e-8ae7-12146196685c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.148430 May 12 17:53:41.491043 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 472/909] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:41 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:42.506966 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:42.507584 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:42.515283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:42.515792 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:42.516617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:42.517056 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:42.650868 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:42.658888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f48bbec5-f99d-4f25-8170-b7fb1f5768af tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.155998 May 12 17:53:42.659457 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 438/910] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:42 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:43.677306 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:43.677911 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:43.684752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:43.685198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:43.685956 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:43.686397 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:43.753566 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:43.754614 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:43.761166 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:43.762199 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:43.762985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:43.763425 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:43.816845 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:43.825551 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fc6e816d-93ad-4ee3-886e-7fb823c3ef85 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.152020 May 12 17:53:43.826449 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 473/911] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:43 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:43.844715 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-30464712-2249-4647-8950-bc8ebcf56167 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/action" status: 202 len: 0 microversion: 2.1 time: 0.094783 May 12 17:53:43.846999 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 439/912] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:53:43 2022] POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:53:43.854732 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:43.855465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:43.861421 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:43.861910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:43.862926 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:43.863490 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:44.012554 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:44.020567 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-da7b3e09-5250-4e45-b5cd-ee4a712e35cd tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1749 microversion: 2.1 time: 0.170624 May 12 17:53:44.021148 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 474/913] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:43 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:44.844525 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:44.845232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:44.851324 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:44.851780 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:44.852598 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:44.853041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:44.983234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:44.990955 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-38c2a340-5b52-4698-8755-200184fd6b21 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.152075 May 12 17:53:44.991556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 440/914] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:44 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:45.037568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:45.038207 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:45.045047 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:45.045486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:45.046243 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:45.046671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:45.342508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:45.350257 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6be9dfcf-e4e6-4b55-80e0-8cd2da81ccf3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.316473 May 12 17:53:45.350832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 475/915] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:45 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:46.010783 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:46.012458 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:46.020325 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:46.020852 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:46.021757 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:46.022212 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:46.162530 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:46.171254 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-77e8ca3b-1f95-4629-b502-2d2dc1aca29b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.165208 May 12 17:53:46.172100 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 441/916] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:46 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:46.369100 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:46.370041 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:46.378183 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:46.378932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:46.380271 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:46.380750 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:46.522073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:46.530326 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-146661ae-3273-4b6b-a1ab-9c92d14861d6 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.166426 May 12 17:53:46.530880 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 476/917] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:46 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:47.188593 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:47.189213 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:47.195512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:47.195967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:47.196770 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:47.197217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:47.324982 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:47.333118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-65526846-08cb-48ed-86fd-1be3ff358d6f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.148431 May 12 17:53:47.333736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 442/918] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:47 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:47.547007 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:47.547525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:47.553802 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:47.554248 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:47.555003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:47.555432 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:47.695725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:47.704079 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-09f89c42-26bd-4329-8495-72daac4bcbd2 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.161078 May 12 17:53:47.704663 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 477/919] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:47 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:48.350834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:48.351506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:48.359069 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:48.359554 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:48.360403 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:48.360901 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:48.486855 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:48.494678 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-5ac1aed8-50ab-42d3-b568-a73f00b954e8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.147810 May 12 17:53:48.495249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 443/920] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:48 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:48.722799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:48.723524 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:48.730160 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:48.730612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:48.731392 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:48.731831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:48.870321 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:48.878106 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-be906d33-52b2-4255-ab53-241a2dbcac2b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.159217 May 12 17:53:48.878671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 478/921] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:48 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:53:49.512333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:49.512954 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:49.519240 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:49.519690 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:49.520487 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:49.520930 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:49.647135 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:49.655901 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6429fed2-cfb5-455d-b6c8-52ffaedcfaee tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.147712 May 12 17:53:49.656528 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 444/922] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:49 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:49.896119 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:49.896686 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:49.903524 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:49.903969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:49.904759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:49.905188 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:50.049052 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:50.056870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f35b62ab-976c-4c21-908c-5c799d52096a tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.164818 May 12 17:53:50.057445 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 479/923] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:49 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:50.673276 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:50.673914 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:50.680494 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:50.680987 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:50.681820 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:50.682269 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:50.816321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:50.824080 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-042f743b-bd9e-4fd8-b168-a6adc1ea410c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1723 microversion: 2.1 time: 0.154760 May 12 17:53:50.824692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 445/924] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:50 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:53:51.074817 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:51.075424 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:51.081756 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:51.082206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:51.082971 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:51.083410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:51.221605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:51.229352 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ff37248f-6d58-4968-ba61-0e87f9f0c4e5 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.158518 May 12 17:53:51.230029 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 480/925] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:51 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:51.841700 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:51.842308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:51.848617 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:51.849070 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:51.849843 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:51.850284 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:51.980962 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:51.988619 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1f68e979-d63b-406e-8bf6-99c0724e0c31 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1700 microversion: 2.1 time: 0.150876 May 12 17:53:51.989178 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 446/926] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:51 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:52.004832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f78a9a33-6ee5-455b-a682-b5811ddbac8d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:53:52.011106 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f78a9a33-6ee5-455b-a682-b5811ddbac8d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:52.011771 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f78a9a33-6ee5-455b-a682-b5811ddbac8d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:52.035019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f78a9a33-6ee5-455b-a682-b5811ddbac8d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Going to try to start instance {{(pid=123520) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 17:53:52.074638 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f78a9a33-6ee5-455b-a682-b5811ddbac8d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action" status: 202 len: 0 microversion: 2.1 time: 0.073498 May 12 17:53:52.075221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 481/927] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:53:51 2022] POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:53:52.083277 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:52.083896 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:52.090596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:52.091056 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:52.092105 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:52.092713 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:52.223296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:52.231687 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b681bd5a-41d1-4f33-8730-051d8394525b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1709 microversion: 2.1 time: 0.152208 May 12 17:53:52.232471 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 447/928] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:52 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:52.247358 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:52.248092 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:52.254648 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:52.255365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:52.256137 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:52.256629 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:52.401893 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:52.413612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-311475e0-1b78-498d-8db6-1c3400777d87 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.170497 May 12 17:53:52.414455 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 482/929] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:52 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:53.249924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:53.250543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:53.257154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:53.257613 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:53.258390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:53.258837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:53.384546 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:53.394932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-95c1a66a-4684-491d-9807-58a9c1b03a77 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1709 microversion: 2.1 time: 0.149004 May 12 17:53:53.394932 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 448/930] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:53 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:53.431133 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:53.431756 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:53.438681 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:53.439110 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:53.439960 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:53.440459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:53.580587 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:53.588306 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3d23009f-2600-4e6f-9cd5-c70a0015896b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.160885 May 12 17:53:53.588864 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 483/931] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:53 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:54.412863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:54.413485 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:54.420228 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:54.420688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:54.421471 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:54.421916 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:54.550998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:54.559431 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-62624ed1-9dee-465b-b3e0-6c9c714f8264 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1713 microversion: 2.1 time: 0.150420 May 12 17:53:54.559990 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 449/932] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:54 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:54.605906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:54.606513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:54.612842 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:54.613293 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:54.614067 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:54.614510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:54.755501 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:54.763477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-24d6a06d-8e12-401e-a73a-1f762091b3ae tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1754 microversion: 2.1 time: 0.162016 May 12 17:53:54.764051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 484/933] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:54 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:53:55.781951 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:53:55.783219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:53:55.789962 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:55.790421 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:55.791201 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:53:55.791652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:53:55.943484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:53:55.952531 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-658988cd-e61a-4ff0-82ad-0852e9f44573 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1757 microversion: 2.1 time: 0.175630 May 12 17:53:55.953097 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 450/934] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:53:55 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:28.617426 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-816415032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1380938625", "security_groups": [{"name": "tempest-secgroup-smoke-948308070"}], "block_device_mapping_v2": [{"uuid": "54d1ca9c-cb18-452c-8564-96e9dc4c6ffe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a25dbb6f-d15b-498d-a498-e2acebdb3c69"}]}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:28.726006 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.network.neutron [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] validate_networks() for [('a25dbb6f-d15b-498d-a498-e2acebdb3c69', None, None, None, None, None)] {{(pid=123520) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:54:29.089992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Flavor limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:54:29.090415 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Image limits 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:54:29.090918 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Flavor pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:54:29.091326 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Image pref 0:0:0 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:54:29.091735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.virt.hardware [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:54:29.100211 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:29.100659 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:29.101460 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:29.101896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:29.118719 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:54:29.123385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Getting quotas for user adbaa9b8b7e2447da5eef8f32aff22a1 and project a4d7ebeafe8140b3b8332059258a83eb. Resources: {'cores', 'instances', 'ram'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:54:29.178759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Going to run 1 instances... {{(pid=123520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:54:29.180866 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54d1ca9c-cb18-452c-8564-96e9dc4c6ffe',volume_size=None,volume_type=None)] {{(pid=123520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:54:29.304105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7451464f-f598-4dd6-93a5-d2c2764aa21a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.690754 May 12 17:54:29.304748 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 485/935] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:54:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:54:29.315167 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6f357738-ab66-4a35-bf12-8e11f62063fa tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:29.315776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6f357738-ab66-4a35-bf12-8e11f62063fa tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:29.367238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6f357738-ab66-4a35-bf12-8e11f62063fa tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:29.374739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6f357738-ab66-4a35-bf12-8e11f62063fa tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1094 microversion: 2.1 time: 0.063492 May 12 17:54:29.375375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 451/936] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:29 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:30.393882 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:30.395171 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:30.403332 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:30.403769 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:30.404815 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:30.405278 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:30.470096 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:30.477796 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-776bef9c-2d7c-4c68-abc7-e221aca91b91 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1210 microversion: 2.1 time: 0.088640 May 12 17:54:30.479323 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 486/937] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:30 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:31.495689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:31.496434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:31.502799 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:31.503254 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:31.504037 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:31.504517 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:31.662190 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:31.670463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-44e6eed3-0c3b-4545-b33b-4acc93a63019 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.178591 May 12 17:54:31.671267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 452/938] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:31 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:31.808135 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-743ecbdd-7778-42d9-87e1-40ee0358338f req-08b8744e-cedf-4652-87b2-e9b49eede5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03bed6f-d0ca-490a-a621-94a6938cfa83", "tag": "508b21df-7040-42d8-a984-3cff154f2c4e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:31.829564 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-743ecbdd-7778-42d9-87e1-40ee0358338f req-08b8744e-cedf-4652-87b2-e9b49eede5c1 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:31.830099 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-743ecbdd-7778-42d9-87e1-40ee0358338f req-08b8744e-cedf-4652-87b2-e9b49eede5c1 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:31.845393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-743ecbdd-7778-42d9-87e1-40ee0358338f req-08b8744e-cedf-4652-87b2-e9b49eede5c1 service nova] Creating event network-changed:508b21df-7040-42d8-a984-3cff154f2c4e for instance d03bed6f-d0ca-490a-a621-94a6938cfa83 on hv-cinder-84052 May 12 17:54:31.852093 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-743ecbdd-7778-42d9-87e1-40ee0358338f req-08b8744e-cedf-4652-87b2-e9b49eede5c1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047882 May 12 17:54:31.852890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 487/939] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:32.687466 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:32.688181 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:32.694419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:32.694865 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:32.695625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:32.696059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:32.825945 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:32.833271 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-42cada6f-65ce-484a-8da9-b629962c93c5 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.149634 May 12 17:54:32.833928 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 453/940] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:32 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:33.433124 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:33.433700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:33.439788 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:33.440283 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:33.441078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:33.441516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:33.519891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lazy-loading 'services' on Instance uuid 3f2dcfe1-505b-479b-adee-02927130d745 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:54:33.591935 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d8a02730-fb7a-4345-8b2e-b5a513db9393 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-volume_attachments/0b7b4b7c-ba8a-4d66-9866-b7d38f845474" status: 202 len: 0 microversion: 2.1 time: 0.163902 May 12 17:54:33.592645 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 488/941] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:54:33 2022] DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-volume_attachments/0b7b4b7c-ba8a-4d66-9866-b7d38f845474 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:33.850085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:33.850790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:33.857747 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:33.858202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:33.858974 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:33.859424 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:33.994709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:34.002145 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-aac76641-9c1a-436f-8c4b-7f38d1458d8a tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.155853 May 12 17:54:34.002708 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 454/942] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:33 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:34.709281 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ff1ce2f6-042a-4b7f-8fb9-24187ee157fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:34.715474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff1ce2f6-042a-4b7f-8fb9-24187ee157fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:34.715933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ff1ce2f6-042a-4b7f-8fb9-24187ee157fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:34.723043 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-72850202"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:34.723605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:34.730004 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:34.730496 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:34.731295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:34.731739 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:34.741003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ff1ce2f6-042a-4b7f-8fb9-24187ee157fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Going to try to stop instance {{(pid=123520) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 17:54:34.784259 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ff1ce2f6-042a-4b7f-8fb9-24187ee157fd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action" status: 202 len: 0 microversion: 2.1 time: 0.079059 May 12 17:54:34.785132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 489/943] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:54:34 2022] POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:34.794824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:34.795525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:34.801595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:34.802050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:34.802824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:34.803409 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:34.884776 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.network.security_group_api [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Removing security group 42d35ccf-3e40-401e-b904-903627502614 from port d261cc65-c224-4075-af4c-05eb1e85cf9b May 12 17:54:35.005552 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:35.013267 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-33405fef-cad7-4eb6-92be-533aaef8e4dd tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.224142 May 12 17:54:35.014026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 490/944] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:34 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:35.018540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:35.019140 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:35.025007 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:35.025457 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:35.026799 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:35.027245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:35.503052 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:35.511887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-92980a61-f0ee-42ca-a1be-1be8fff1f824 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.495778 May 12 17:54:35.512841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 491/945] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:35 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:35.644098 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6add9ebf-0b91-48e0-88e4-63bdaa32fd78 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/action" status: 202 len: 0 microversion: 2.1 time: 0.924809 May 12 17:54:35.647989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 455/946] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:54:34 2022] POST /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:54:35.657514 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-2d4f98dc-2705-485c-9a72-c4cf36f37f7d req-12ff8e46-5a39-43fd-8f7d-82c38af2df87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:35.680782 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2d4f98dc-2705-485c-9a72-c4cf36f37f7d req-12ff8e46-5a39-43fd-8f7d-82c38af2df87 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:35.681504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-2d4f98dc-2705-485c-9a72-c4cf36f37f7d req-12ff8e46-5a39-43fd-8f7d-82c38af2df87 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:35.708459 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-2d4f98dc-2705-485c-9a72-c4cf36f37f7d req-12ff8e46-5a39-43fd-8f7d-82c38af2df87 service nova] Creating event network-changed:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:54:35.716914 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-2d4f98dc-2705-485c-9a72-c4cf36f37f7d req-12ff8e46-5a39-43fd-8f7d-82c38af2df87 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062858 May 12 17:54:35.717844 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 492/947] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:36.031843 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:36.032500 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:36.039322 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:36.039983 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:36.040989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:36.041596 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:36.246580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:36.254095 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4e22656a-63b3-411d-8406-0eca6bbce2a5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.226627 May 12 17:54:36.254670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 456/948] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:36 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:36.530126 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:36.530888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:36.537519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:36.537984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:36.538797 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:36.539244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:36.770743 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:36.777977 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-eee0c01b-d5e7-4925-93d0-a7e98c7ef1e0 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.253044 May 12 17:54:36.778540 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 493/949] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:36 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:36.986749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:36.987249 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:36.993217 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:36.993672 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:36.994441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:36.995512 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.073262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lazy-loading 'services' on Instance uuid b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:54:37.150292 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0ed5d750-613e-40cf-a542-9ae6085671fe tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments/dc40b59b-58ae-4a4d-9940-25b5c33a919d" status: 202 len: 0 microversion: 2.1 time: 0.167277 May 12 17:54:37.151160 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 457/950] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:54:36 2022] DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments/dc40b59b-58ae-4a4d-9940-25b5c33a919d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:37.159249 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:37.160341 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:37.167786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.168343 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.169405 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.170026 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.200331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-e2dbd454-b98f-4186-868a-2c5c49e2a5d3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044881 May 12 17:54:37.200896 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 494/951] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:54:37 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:37.272752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:37.273597 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:37.280186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.280660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.281441 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.281886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.417048 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:37.425556 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-4a37a6c7-0db9-41d3-8938-8bb98cc40255 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.156970 May 12 17:54:37.426162 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 458/952] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:37 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:37.733423 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-e202e09c-2937-438a-8c45-0bf89b8ae666 req-41a73b2c-87b2-4619-8d28-aee6b13c8a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:37.743307 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-e202e09c-2937-438a-8c45-0bf89b8ae666 req-41a73b2c-87b2-4619-8d28-aee6b13c8a6e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.743755 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-e202e09c-2937-438a-8c45-0bf89b8ae666 req-41a73b2c-87b2-4619-8d28-aee6b13c8a6e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.755567 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-e202e09c-2937-438a-8c45-0bf89b8ae666 req-41a73b2c-87b2-4619-8d28-aee6b13c8a6e service nova] Creating event network-changed:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:54:37.760930 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-e202e09c-2937-438a-8c45-0bf89b8ae666 req-41a73b2c-87b2-4619-8d28-aee6b13c8a6e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032150 May 12 17:54:37.761532 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 495/953] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:37.844286 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:37.844920 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:37.851731 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.852283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.853170 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:37.853818 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:37.997444 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:38.005131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-2b5c54af-10ae-478f-b3ba-3aa9ac632909 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.214633 May 12 17:54:38.005960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 459/954] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:37 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:38.212325 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:38.213346 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:38.220329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:38.220783 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:38.221548 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:38.221985 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:38.251398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9cbfbb4d-7365-4dfc-8787-98c380cff33f tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 May 12 17:54:38.251957 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 496/955] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:54:38 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:38.443195 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:38.443808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:38.450878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:38.451329 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:38.452097 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:38.452558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:38.579954 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:38.587316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ca46470d-e268-4b4c-8ce0-cc3e788e8af2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.147959 May 12 17:54:38.587877 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 460/956] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:38 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:39.025463 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:39.026752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:39.037867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.038690 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.040121 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.041000 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.175359 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:39.183566 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ed345c93-4639-432a-92f9-3c389e97e5ad tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.164211 May 12 17:54:39.184259 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 497/957] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:39 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:39.262472 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:39.263452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:39.269274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.269722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.270481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.270950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.298147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a07c72f8-d550-4f06-9a8d-a7c4fad514c3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039609 May 12 17:54:39.298689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 461/958] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:54:39 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:54:39.309363 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:39.309831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:39.315623 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.316084 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.316887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.317330 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.392932 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] HTTP exception thrown: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa is not attached to volume dc40b59b-58ae-4a4d-9940-25b5c33a919d May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Request method failure captured: May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments/dc40b59b-58ae-4a4d-9940-25b5c33a919d HTTP/1.1 May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUlYlYcCeSwECA58bnbx9BjD6_amyYjWLckttUQzQ9wacbTDBmJ1-LTgzh66LF4gQHQlHUskWYZk9BYXHgGLJ8G019m9vUBlSaNlluXVja_J77HVcLCSC19YvNU0jlUkAy1kh4a0zmVA-xAk8Gr4W77EiVQoSvuTHtEMTw8G0Id74zk May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 22f9cad467614c16acb967c11da20d7f May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-TestMinimumBasicScenario-1547524367 May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:54:39.395310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/22f9cad467614c16acb967c11da20d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22f9cad467614c16acb967c11da20d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22f9cad467614c16acb967c11da20d7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_22f9cad467614c16acb967c11da20d7f", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-TestMinimumBasicScenario-1547524367 May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 22f9cad467614c16acb967c11da20d7f May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1547524367 May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-TestMinimumBasicScenario-1547524367-project May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 9c6f9b63000c47628980c8b435f12043 May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-TestMinimumBasicScenario-1547524367-project May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:54:39.397149 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa is not attached to volume dc40b59b-58ae-4a4d-9940-25b5c33a919d May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'server_id': 'b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa', 'id': 'dc40b59b-58ae-4a4d-9940-25b5c33a919d'} May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dc40b59b-58ae-4a4d-9940-25b5c33a919d. May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:54:39.398082 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa is not attached to volume dc40b59b-58ae-4a4d-9940-25b5c33a919d May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa is not attached to volume dc40b59b-58ae-4a4d-9940-25b5c33a919d May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:39.399605 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Returning 404 to user: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa is not attached to volume dc40b59b-58ae-4a4d-9940-25b5c33a919d {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:54:39.401141 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5c9af922-0eae-4474-9e2a-3b19f75d3b1e tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments/dc40b59b-58ae-4a4d-9940-25b5c33a919d" status: 404 len: 154 microversion: 2.1 time: 0.092520 May 12 17:54:39.401141 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 498/959] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:54:39 2022] DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa/os-volume_attachments/dc40b59b-58ae-4a4d-9940-25b5c33a919d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:54:39.606316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:39.606920 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:39.613279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.613983 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.614935 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:39.615552 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:39.766905 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:39.774373 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3beb2878-242b-4a0d-ba10-ede92dfe574d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.172702 May 12 17:54:39.774946 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 462/960] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:39 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:40.202800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:40.204011 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:40.211713 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.212198 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.212969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.213874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.352483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:40.361640 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-71944bb5-2172-4921-a144-8e6f0c19fe6e tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.165215 May 12 17:54:40.362362 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 499/961] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:40 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:40.537200 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:40.537704 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:40.543730 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.544215 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.545000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.545442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.579000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:54:40.655694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-9c2f378a-4d33-4941-b1b5-ca86d6f3578c tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 204 len: 0 microversion: 2.1 time: 0.122008 May 12 17:54:40.656419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 463/962] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:54:40 2022] DELETE /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:54:40.669248 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:40.670367 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:40.677565 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.678009 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.678774 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.679224 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.794933 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:40.795674 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:40.801569 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.802024 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.802811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:40.803253 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:40.804346 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:40.812186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-bd474307-7f8e-4c57-8dd7-7bd9f5642ee3 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1553 microversion: 2.1 time: 0.150961 May 12 17:54:40.812791 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 500/963] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:40 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:40.936524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:40.943835 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e8361da3-cbd2-4cd6-a967-f3cdd69a4e0d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.153198 May 12 17:54:40.944435 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 464/964] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:40 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:41.381442 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:41.382065 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:41.388664 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.389166 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.390019 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.390465 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.517968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:41.525244 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5a30175b-5c82-44c8-910a-9d3e77414456 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.148491 May 12 17:54:41.525806 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 501/965] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:41 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:41.830319 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:41.830939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:41.837348 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.837804 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.838652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.839094 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.841710 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-c57e9152-d627-46dd-a43a-1aefc58847a2 req-a86c1839-d03e-45e9-92ef-945343fddd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03bed6f-d0ca-490a-a621-94a6938cfa83", "name": "network-vif-plugged", "status": "completed", "tag": "508b21df-7040-42d8-a984-3cff154f2c4e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:41.850351 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-c57e9152-d627-46dd-a43a-1aefc58847a2 req-a86c1839-d03e-45e9-92ef-945343fddd91 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.850832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-c57e9152-d627-46dd-a43a-1aefc58847a2 req-a86c1839-d03e-45e9-92ef-945343fddd91 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.863668 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-c57e9152-d627-46dd-a43a-1aefc58847a2 req-a86c1839-d03e-45e9-92ef-945343fddd91 service nova] Creating event network-vif-plugged:508b21df-7040-42d8-a984-3cff154f2c4e for instance d03bed6f-d0ca-490a-a621-94a6938cfa83 on hv-cinder-84052 May 12 17:54:41.868715 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-c57e9152-d627-46dd-a43a-1aefc58847a2 req-a86c1839-d03e-45e9-92ef-945343fddd91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031027 May 12 17:54:41.869319 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 502/966] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:54:41.962162 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:41.962778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:41.969051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.969518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.970304 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:41.970746 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:41.982854 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:41.991202 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-76b7eb8c-bafe-413a-a4d8-35fe50482eed tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1553 microversion: 2.1 time: 0.164871 May 12 17:54:41.991794 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 465/967] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:41 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:42.099887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:42.107288 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f07bcd30-5fdc-4880-ad0f-7aec37d90b9d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.149418 May 12 17:54:42.107862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 503/968] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:41 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:42.543269 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:42.543886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:42.549672 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:42.550120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:42.550886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:42.551321 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:42.841887 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:42.849084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-dfcfa8c9-1e99-4cc2-8d27-369002e02cbd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.310269 May 12 17:54:42.849637 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 466/969] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:42 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:43.008429 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:43.009048 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:43.015775 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:43.016249 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:43.017025 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:43.017458 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:43.124977 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:43.125891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:43.134133 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:43.134808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:43.136614 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:43.137280 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:43.160228 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:43.167664 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5fa31158-7619-4a9a-94e1-e5b5f1f1b7ce tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1553 microversion: 2.1 time: 0.163427 May 12 17:54:43.168266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 504/970] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:43 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:43.269354 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:43.275623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-97f69eba-689b-419e-911b-7bc004b9967b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.154379 May 12 17:54:43.277408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 467/971] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:43 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:43.866585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:43.867212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:43.873946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:43.874391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:43.875160 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:43.875594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:44.008671 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:44.016282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2d056e14-a71a-4afc-a3bc-e3ae126070ac tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1265 microversion: 2.1 time: 0.153584 May 12 17:54:44.016857 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 505/972] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:43 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:44.140442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-f08276ec-ac6f-4796-8cb6-c73f4dac1e6f req-ffa2cc9c-6693-4d3a-bf7e-a60745376226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa", "name": "network-vif-deleted", "tag": "d261cc65-c224-4075-af4c-05eb1e85cf9b"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:44.148781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-f08276ec-ac6f-4796-8cb6-c73f4dac1e6f req-ffa2cc9c-6693-4d3a-bf7e-a60745376226 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:44.149237 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-f08276ec-ac6f-4796-8cb6-c73f4dac1e6f req-ffa2cc9c-6693-4d3a-bf7e-a60745376226 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:44.160706 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-f08276ec-ac6f-4796-8cb6-c73f4dac1e6f req-ffa2cc9c-6693-4d3a-bf7e-a60745376226 service nova] Creating event network-vif-deleted:d261cc65-c224-4075-af4c-05eb1e85cf9b for instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa on hv-cinder-84052 May 12 17:54:44.165447 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-f08276ec-ac6f-4796-8cb6-c73f4dac1e6f req-ffa2cc9c-6693-4d3a-bf7e-a60745376226 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028664 May 12 17:54:44.166008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 468/973] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:44.183938 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:44.184575 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:44.190489 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:44.190943 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:44.191713 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:44.192150 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:44.253079 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f9b63000c47628980c8b435f12043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f9cad467614c16acb967c11da20d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:44.261925 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1474de98-5501-45a7-a61f-0fff58c3646b tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 200 len: 1511 microversion: 2.1 time: 0.082009 May 12 17:54:44.262717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 506/974] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:44 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 1511 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:44.295041 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:44.295960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:44.302190 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:44.302670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:44.303442 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:44.303878 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:44.442160 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:44.451154 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f0f1fd1c-972e-43aa-9dd7-8c04184d6b79 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1677 microversion: 2.1 time: 0.161244 May 12 17:54:44.452316 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 469/975] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:44 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:45.033134 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:45.033777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:45.040027 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.040512 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.041282 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.041720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.171438 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:45.179481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-aecc7f25-f443-4e95-ad36-515bf34ea768 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1451 microversion: 2.1 time: 0.150066 May 12 17:54:45.180239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 507/976] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:45 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:45.196299 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:45.196949 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:45.204736 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.205190 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.205970 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.206555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.279270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:45.279995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] [instance: b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:45.287192 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.287685 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.288525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.289013 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.303261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] HTTP exception thrown: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa could not be found. May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Request method failure captured: May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa HTTP/1.1 May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUlYlYcCeSwECA58bnbx9BjD6_amyYjWLckttUQzQ9wacbTDBmJ1-LTgzh66LF4gQHQlHUskWYZk9BYXHgGLJ8G019m9vUBlSaNlluXVja_J77HVcLCSC19YvNU0jlUkAy1kh4a0zmVA-xAk8Gr4W77EiVQoSvuTHtEMTw8G0Id74zk May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 22f9cad467614c16acb967c11da20d7f May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-TestMinimumBasicScenario-1547524367 May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:54:45.304967 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/22f9cad467614c16acb967c11da20d7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22f9cad467614c16acb967c11da20d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22f9cad467614c16acb967c11da20d7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_22f9cad467614c16acb967c11da20d7f", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-TestMinimumBasicScenario-1547524367 May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 22f9cad467614c16acb967c11da20d7f May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1547524367 May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-TestMinimumBasicScenario-1547524367-project May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 9c6f9b63000c47628980c8b435f12043 May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-TestMinimumBasicScenario-1547524367-project May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa could not be found. May 12 17:54:45.306576 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa'} May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa could not be found. May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:54:45.307519 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa could not be found. May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa could not be found. May 12 17:54:45.309597 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:54:45.310993 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Returning 404 to user: Instance b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:54:45.310993 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-de26cd8e-146f-443f-aeb7-7d01b1e60473 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa" status: 404 len: 111 microversion: 2.1 time: 0.031389 May 12 17:54:45.310993 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 508/977] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:45 2022] GET /compute/v2.1/servers/b5dc0c5f-e2d5-42a1-bd49-b8d2b2ac17aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 17:54:45.315390 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-20f41f72-e0c5-44c1-b8fc-63aab683ee77 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] Calling method '.version_select at 0x7fc0cb228310>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:45.333453 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-20f41f72-e0c5-44c1-b8fc-63aab683ee77 tempest-TestMinimumBasicScenario-1547524367 tempest-TestMinimumBasicScenario-1547524367-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-484908177" status: 202 len: 0 microversion: 2.1 time: 0.021657 May 12 17:54:45.334031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 509/978] 10.222.0.73 () {58 vars in 1268 bytes} [Thu May 12 17:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-484908177 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:45.343438 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:45.352264 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8d244fce-972b-4205-8608-7e01ab7fc0b8 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1451 microversion: 2.1 time: 0.159995 May 12 17:54:45.352898 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 470/979] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:45 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:45.470268 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:45.470888 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:45.477059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.477334 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.478264 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.478526 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.718035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:45.741532 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-19ca4ff0-3bac-4b5a-a10e-94cefdcbb1f9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1654 microversion: 2.1 time: 0.275626 May 12 17:54:45.742337 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 510/980] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:45 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1654 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:45.760430 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-48f0098a-31f5-483e-be07-63007186b503 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:45.771917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-48f0098a-31f5-483e-be07-63007186b503 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.772260 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-48f0098a-31f5-483e-be07-63007186b503 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.838871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-48f0098a-31f5-483e-be07-63007186b503 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Going to try to start instance {{(pid=123519) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 17:54:45.884848 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-48f0098a-31f5-483e-be07-63007186b503 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action" status: 202 len: 0 microversion: 2.1 time: 0.129698 May 12 17:54:45.885643 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 471/981] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:54:45 2022] POST /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:45.895071 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:45.895761 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:45.903650 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.904439 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:45.905448 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:45.905895 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:46.229547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:46.238001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1effb95f-d283-4d9a-b660-a4e3fdabadd7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1663 microversion: 2.1 time: 0.347080 May 12 17:54:46.238833 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 511/982] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:45 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1663 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:46.253721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:46.254925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:46.262098 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:46.262943 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:46.263730 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:46.264196 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:46.287179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lazy-loading 'flavor' on Instance uuid e980ad9a-20f5-4380-92ad-2e15e178af1b {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:54:46.361821 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a7a6cf3d-5e4c-4438-976d-a0987646d0fb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "POST /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b/action" status: 202 len: 0 microversion: 2.1 time: 0.112791 May 12 17:54:46.363150 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 472/983] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:54:46 2022] POST /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:46.371808 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:46.372568 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:46.378980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:46.380051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:46.381350 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:46.382136 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:46.991749 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:46.999513 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9ef24875-4780-4fd6-9f8a-24ec130e6450 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.632114 May 12 17:54:47.000127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 512/984] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:46 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:54:47.256926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:47.257691 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:47.264614 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:47.265076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:47.265883 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:47.266349 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:47.592978 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:47.600262 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b3c4861b-9e66-4948-9f04-c99b1e8325fa tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1663 microversion: 2.1 time: 0.348543 May 12 17:54:47.600839 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 473/985] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:47 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1663 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:48.017333 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:48.019514 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:48.026138 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:48.027176 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:48.028238 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:48.028748 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:48.345018 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:48.352538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-68513696-3f38-459b-baa7-dbdd04448389 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.339056 May 12 17:54:48.353202 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 513/986] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:48 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:48.617259 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:48.617888 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:48.624740 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:48.625205 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:48.625995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:48.626440 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:49.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:49.101884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b8953b36-0ca4-425f-b4f8-1c65a99f12a0 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1667 microversion: 2.1 time: 0.488894 May 12 17:54:49.102790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 474/987] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:48 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1667 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:49.184336 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-edc16b02-1ccc-4eaa-b3dd-fd526cf49f29 req-57988e51-c08d-47a4-a667-bcd2447529f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03bed6f-d0ca-490a-a621-94a6938cfa83", "tag": "508b21df-7040-42d8-a984-3cff154f2c4e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:49.193467 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-edc16b02-1ccc-4eaa-b3dd-fd526cf49f29 req-57988e51-c08d-47a4-a667-bcd2447529f8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:49.194554 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-edc16b02-1ccc-4eaa-b3dd-fd526cf49f29 req-57988e51-c08d-47a4-a667-bcd2447529f8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:49.208463 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-edc16b02-1ccc-4eaa-b3dd-fd526cf49f29 req-57988e51-c08d-47a4-a667-bcd2447529f8 service nova] Creating event network-changed:508b21df-7040-42d8-a984-3cff154f2c4e for instance d03bed6f-d0ca-490a-a621-94a6938cfa83 on hv-cinder-84052 May 12 17:54:49.213584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-edc16b02-1ccc-4eaa-b3dd-fd526cf49f29 req-57988e51-c08d-47a4-a667-bcd2447529f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 May 12 17:54:49.215123 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 514/988] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:54:49.378749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:49.382732 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:49.394547 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:49.395381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:49.396363 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:49.396958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:49.555809 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:49.564976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b2dcf4dd-ddcc-4168-8ad5-940be91cd8a3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.197714 May 12 17:54:49.566275 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 475/989] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:49 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:50.583227 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:50.584633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:50.593410 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:50.593861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:50.594727 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:50.595180 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:50.733758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:50.742374 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9a6c83f0-15d9-4d7d-a298-3fc006f33bf3 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.163296 May 12 17:54:50.742961 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 515/990] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:50 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:51.759361 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:51.759991 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:51.766631 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:51.767092 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:51.767880 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:51.768426 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:51.973474 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:51.981247 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-252f396f-1923-4e98-86ee-b1fbe24f6bf1 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.226234 May 12 17:54:51.981813 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 476/991] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:51 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:52.999350 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:52.999953 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:53.007373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:53.007955 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:53.008772 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:53.009212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:53.222200 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:53.230295 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-063bdc50-0431-4e69-8579-8458e952be29 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.235124 May 12 17:54:53.230867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 516/992] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:52 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:54.247060 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:54.247689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:54.254028 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:54.254893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:54.256296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:54.257013 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:54.759376 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:54.770345 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3dbb3c76-4080-427d-9ce2-7efb632ea831 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.527274 May 12 17:54:54.770924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 477/993] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:54 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:55.789665 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:55.791085 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:55.798369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:55.798823 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:55.799626 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:55.800073 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:56.151983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:56.159266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-edb72a7f-1705-46fa-9b98-0fea56b5edae tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.375276 May 12 17:54:56.159827 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 517/994] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:55 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:57.177120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:57.177970 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:57.184800 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:57.185259 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:57.186054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:57.186492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:57.376051 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:57.384555 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-85cfe18e-9f55-4ac8-a704-4edd2f9d5156 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.211914 May 12 17:54:57.385117 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 478/995] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:57 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:58.402108 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:58.402887 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:58.408820 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:58.409281 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:58.410059 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:58.410500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:58.536038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:58.543874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1611041b-60dc-49b1-aa2f-57c410b09ccb tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.146430 May 12 17:54:58.544456 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 518/996] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:58 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:59.561349 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:59.561924 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:59.568140 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:59.568625 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:59.569404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:59.569852 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:59.700751 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:54:59.708282 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a6e66b36-3a87-4664-86e1-fbd1804a3a84 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1571 microversion: 2.1 time: 0.151982 May 12 17:54:59.708853 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 479/997] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:59 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:54:59.725045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:54:59.725674 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:59.732717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:59.733175 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:59.733986 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:59.735118 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:59.816239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b687fe69-c88a-41f9-8d8f-1306c0c74778 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "POST /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b/action" status: 202 len: 0 microversion: 2.1 time: 0.095040 May 12 17:54:59.816778 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 519/998] 10.222.0.73 () {60 vars in 1277 bytes} [Thu May 12 17:54:59 2022] POST /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:54:59.824697 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:54:59.825969 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:54:59.832421 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:59.832875 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:54:59.834522 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:54:59.835267 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:00.005467 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:00.014398 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-85979d85-6894-4b02-954d-a65ac37f9833 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1519 microversion: 2.1 time: 0.193579 May 12 17:55:00.015042 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 480/999] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:54:59 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:55:00.411281 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:55:00.411517 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Thu May 12 17:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:55:01.031586 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:01.032236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:01.038381 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:01.038831 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:01.039596 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:01.040040 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:01.173694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:01.181493 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4bc2e1cf-9c01-4893-9391-87f0919c4400 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1521 microversion: 2.1 time: 0.153851 May 12 17:55:01.182074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 520/1000] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:01 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:55:01.729246 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-658c8102-5be5-4277-aa0c-166b9cde479b req-69577a67-465f-43d0-956d-26d6b924308c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "name": "network-vif-unplugged", "status": "completed", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:01.742201 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-658c8102-5be5-4277-aa0c-166b9cde479b req-69577a67-465f-43d0-956d-26d6b924308c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:01.742694 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-658c8102-5be5-4277-aa0c-166b9cde479b req-69577a67-465f-43d0-956d-26d6b924308c service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:01.755492 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-658c8102-5be5-4277-aa0c-166b9cde479b req-69577a67-465f-43d0-956d-26d6b924308c service nova] Creating event network-vif-unplugged:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:55:01.762454 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-658c8102-5be5-4277-aa0c-166b9cde479b req-69577a67-465f-43d0-956d-26d6b924308c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037017 May 12 17:55:01.763112 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 481/1001] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:02.199518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:02.200135 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:02.206413 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:02.206862 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:02.207634 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:02.208072 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:02.340191 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:02.347582 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-9a05d27b-348c-4cf1-9029-f09951642df6 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.152613 May 12 17:55:02.348077 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 521/1002] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:02 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:03.365366 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:03.366188 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:03.373504 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:03.374048 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:03.374845 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:03.375290 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:03.510315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:03.518431 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-fd09b734-a75d-4aa8-a180-3b3f53e52392 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.157705 May 12 17:55:03.518997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 482/1003] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:03 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:55:04.536111 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:04.536755 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:04.543941 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:04.544424 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:04.545206 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:04.545649 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:04.678980 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:04.686512 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-d00516cb-57f0-49fb-85e4-2a23527d95e9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.154343 May 12 17:55:04.687078 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 522/1004] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:04 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:05.703702 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:05.704364 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:05.710759 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:05.711219 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:05.712001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:05.712476 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:05.845129 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:05.852417 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e32e59ed-5a60-4f80-8f30-c5f34c58fa71 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.152615 May 12 17:55:05.852991 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 483/1005] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:05 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:06.870032 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:06.870767 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:06.876837 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:06.877289 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:06.878057 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:06.878494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:07.009969 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:07.018039 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5ac845e8-b6c2-4f71-bbf0-6b0ceaed6584 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.151997 May 12 17:55:07.018610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 523/1006] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:06 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:08.036157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:08.036831 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:08.043772 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:08.044258 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:08.045039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:08.045482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:08.175287 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:08.183232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0a812a19-f72b-4696-bf51-1e5fa897d15e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.151208 May 12 17:55:08.183803 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 484/1007] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:08 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:09.058704 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:55:09.059345 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Thu May 12 17:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:55:09.201018 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:09.201584 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:09.207898 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:09.208391 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:09.209179 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:09.209612 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:09.340620 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:09.347844 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-1f8b7b47-e4b4-4d0c-9512-bfb3a46b1e99 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1577 microversion: 2.1 time: 0.151414 May 12 17:55:09.348441 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 524/1008] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:09 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:10.365015 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:10.365689 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:10.372616 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:10.373062 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:10.373832 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:10.374268 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:10.507627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:10.515558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-65170173-33eb-443a-9683-c7c8667f9e87 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1564 microversion: 2.1 time: 0.154202 May 12 17:55:10.516125 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 485/1009] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:10 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:11.801183 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-028127bb-4b1b-45f6-9564-2fe4cf9a8491 req-5d2b0717-cb32-4ae4-835e-f204f925dced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "name": "network-vif-plugged", "status": "completed", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:11.812117 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-028127bb-4b1b-45f6-9564-2fe4cf9a8491 req-5d2b0717-cb32-4ae4-835e-f204f925dced service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:11.812673 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-028127bb-4b1b-45f6-9564-2fe4cf9a8491 req-5d2b0717-cb32-4ae4-835e-f204f925dced service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:11.825469 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-028127bb-4b1b-45f6-9564-2fe4cf9a8491 req-5d2b0717-cb32-4ae4-835e-f204f925dced service nova] Creating event network-vif-plugged:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:55:11.831780 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-028127bb-4b1b-45f6-9564-2fe4cf9a8491 req-5d2b0717-cb32-4ae4-835e-f204f925dced service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 May 12 17:55:11.832695 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 525/1010] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:22.201205 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:22.202165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:22.207939 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:22.208432 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:22.209220 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:22.209652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:22.237744 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ac8ed43c-da48-48a0-bf05-c5378aa53870 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041402 May 12 17:55:22.238288 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 486/1011] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:55:22 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:55:22.296212 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:22.296798 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:22.303276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:22.303725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:22.304518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:22.304954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:22.330213 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:55:22.404930 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f079a2b4-e9ae-424b-8c77-f5335a7c103c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 204 len: 0 microversion: 2.1 time: 0.112715 May 12 17:55:22.405523 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 526/1012] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:55:22 2022] DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:55:22.413750 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:22.414365 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:22.421397 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:22.421858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:22.422629 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:22.423075 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:22.550717 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:22.558459 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-a2e3f82f-baa3-464d-b7f1-26e2aed35b1d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1673 microversion: 2.1 time: 0.148510 May 12 17:55:22.559019 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 487/1013] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:22 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:55:23.577221 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:23.577924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:23.584343 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:23.584804 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:23.585595 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:23.586038 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:23.723144 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:23.731276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-29784624-9e40-4cd5-bf8f-4d73b7012329 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1673 microversion: 2.1 time: 0.159227 May 12 17:55:23.732114 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 527/1014] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:23 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:24.749120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:24.749735 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:24.756618 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:24.757072 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:24.757846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:24.758279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:24.894469 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:24.903179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-6d67718a-d998-45f9-af09-d1e92285efcb tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1673 microversion: 2.1 time: 0.157965 May 12 17:55:24.903753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 488/1015] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:24 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:25.608996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-de9ce31a-59ac-465f-9952-c2f54922275d req-bb61750d-1387-4591-995c-270a5dae34c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f2dcfe1-505b-479b-adee-02927130d745", "name": "network-vif-deleted", "tag": "ff249090-5209-40fd-90f9-a63ead339649"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:25.626520 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-de9ce31a-59ac-465f-9952-c2f54922275d req-bb61750d-1387-4591-995c-270a5dae34c8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:25.627303 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-de9ce31a-59ac-465f-9952-c2f54922275d req-bb61750d-1387-4591-995c-270a5dae34c8 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:25.641211 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-de9ce31a-59ac-465f-9952-c2f54922275d req-bb61750d-1387-4591-995c-270a5dae34c8 service nova] Creating event network-vif-deleted:ff249090-5209-40fd-90f9-a63ead339649 for instance 3f2dcfe1-505b-479b-adee-02927130d745 on hv-cinder-84052 May 12 17:55:25.646398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-de9ce31a-59ac-465f-9952-c2f54922275d req-bb61750d-1387-4591-995c-270a5dae34c8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041241 May 12 17:55:25.647510 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 528/1016] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:25.921165 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:25.921716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:25.928626 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:25.929084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:25.929959 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:25.930499 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:25.978383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:25.979410 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:25.980118 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lazy-loading 'fault' on Instance uuid 3f2dcfe1-505b-479b-adee-02927130d745 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:55:26.020210 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:26.028808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ad88a903-494e-4fb8-a90e-8322d82f0171 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 200 len: 1326 microversion: 2.1 time: 0.112001 May 12 17:55:26.029381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 489/1017] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:25 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:27.048414 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:27.049112 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:27.055287 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:27.055746 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:27.056550 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:27.057075 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:27.069981 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] HTTP exception thrown: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Request method failure captured: May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 HTTP/1.1 May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUlQrWahzVyo5spJ0f1PZ3r56zMf5Rhv_KrhTGPcXbadDBWx5Kb1LpUG78WipMlbKk_Rz85qKvoXSdzTtMr4xFzxppoEiBUS-ZhVSk7ihYq_OkdH6Wu_Pz3eqZigkFkAIQd3BsT02ehcOtDE3xuDJ3xTnDBSIWn1VdUMS9tPen1kuFw May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:55:27.071610 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d17edf9c20f0426db1c8a1dbc420ed6c", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeTestJSON-2142373135 May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: bc0ab664f7184cfd9bd6170e92512c48 May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:55:27.073496 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '3f2dcfe1-505b-479b-adee-02927130d745'} May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:55:27.074633 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:55:27.076411 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:55:27.077933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Returning 404 to user: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:55:27.077933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-77b4abd8-95c1-40ba-8c3d-2c7ab2b46562 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 404 len: 111 microversion: 2.1 time: 0.029384 May 12 17:55:27.077933 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 529/1018] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:27 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:55:27.081911 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-cbc49015-17fc-4378-bcb9-5063255d2a6c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '.version_select at 0x7fc0c6092040>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:27.102815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-cbc49015-17fc-4378-bcb9-5063255d2a6c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45454940" status: 202 len: 0 microversion: 2.1 time: 0.024507 May 12 17:55:27.103397 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 490/1019] 10.222.0.73 () {58 vars in 1214 bytes} [Thu May 12 17:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45454940 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:55:27.723398 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-90919fd3-84aa-422b-bf1e-641f057a0747 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: .version_select at 0x7fc0cb3634c0>, body: {"keypair": {"name": "tempest-keypair-419871369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQjzLxTtjawRcth9ThyKEH+z2eBvjccTG0UncbJ0rzPYaCjkJZev0AXGSbckktPERbaLNi3Y8ZQ/e6cxaznDQ6aVxUeVqg7grURox1Sknm/r8i0KHWbv+mdj4A/YAIMSQ=="}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:27.737793 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-90919fd3-84aa-422b-bf1e-641f057a0747 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:55:27.741573 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.quota [None req-90919fd3-84aa-422b-bf1e-641f057a0747 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for user bc0ab664f7184cfd9bd6170e92512c48 and project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'key_pairs'} {{(pid=123520) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:55:27.764906 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-90919fd3-84aa-422b-bf1e-641f057a0747 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045554 May 12 17:55:27.765534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 530/1020] 10.222.0.73 () {60 vars in 1158 bytes} [Thu May 12 17:55:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:29.048709 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1832622707", "imageRef": "f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42aca28f-4d9c-47b5-9afa-e8a9049c9539"}], "security_groups": [{"name": "tempest-securitygroup--639243106"}], "key_name": "tempest-keypair-419871369", "user_data": "}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:29.149076 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.network.neutron [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] validate_networks() for [('42aca28f-4d9c-47b5-9afa-e8a9049c9539', None, None, None, None, None)] {{(pid=123519) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 17:55:29.543206 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Flavor limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 17:55:29.543687 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Image limits 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 17:55:29.544188 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Flavor pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 17:55:29.544602 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Image pref 0:0:0 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 17:55:29.545016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.virt.hardware [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 17:55:29.553632 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:29.554085 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:29.554893 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:29.555336 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:29.571602 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 17:55:29.576279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.quota [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Getting quotas for user bc0ab664f7184cfd9bd6170e92512c48 and project d17edf9c20f0426db1c8a1dbc420ed6c. Resources: {'cores', 'instances', 'ram'} {{(pid=123519) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 17:55:29.586958 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Going to run 1 instances... {{(pid=123519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 17:55:29.590001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9a88cd6-3ff3-4ae0-8c05-abb2804aad8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 17:55:29.637749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f99de088-1629-40d5-98d4-842520942380 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593768 May 12 17:55:29.638499 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 491/1021] 10.222.0.73 () {60 vars in 1146 bytes} [Thu May 12 17:55:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 17:55:29.648907 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-b149b59a-2032-476e-b205-0a3ed76a7f23 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:29.650185 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-b149b59a-2032-476e-b205-0a3ed76a7f23 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:29.704536 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-b149b59a-2032-476e-b205-0a3ed76a7f23 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:29.712389 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-b149b59a-2032-476e-b205-0a3ed76a7f23 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1237 microversion: 2.1 time: 0.067840 May 12 17:55:29.713555 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 531/1022] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:29 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:55:30.730950 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:30.731535 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:30.742879 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:30.743687 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:30.744728 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:30.745908 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:30.812748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:30.820010 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e44d56aa-d7ad-4907-b8c1-4d94dc04e4f5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1297 microversion: 2.1 time: 0.093462 May 12 17:55:30.820810 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 492/1023] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:30 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:31.838909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:31.839547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:31.846045 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:31.846494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:31.847264 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:31.847698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:31.980618 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:31.987970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-abbcbcf6-2e69-4560-b1f9-f1b687cce9d9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.152930 May 12 17:55:31.988566 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 532/1024] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:31 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:32.373409 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-915d95e5-d20e-4803-b541-92e8778dc0d2 req-e12ece59-32d4-4dcc-a59c-0cf1d7bd3e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b1547c-4ed6-4375-b636-8903a85c6b82", "tag": "627ccf4f-4b89-4327-a46b-2d57a4b45759"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:32.381931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-915d95e5-d20e-4803-b541-92e8778dc0d2 req-e12ece59-32d4-4dcc-a59c-0cf1d7bd3e2e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:32.382656 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-915d95e5-d20e-4803-b541-92e8778dc0d2 req-e12ece59-32d4-4dcc-a59c-0cf1d7bd3e2e service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:32.396724 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-915d95e5-d20e-4803-b541-92e8778dc0d2 req-e12ece59-32d4-4dcc-a59c-0cf1d7bd3e2e service nova] Creating event network-changed:627ccf4f-4b89-4327-a46b-2d57a4b45759 for instance 30b1547c-4ed6-4375-b636-8903a85c6b82 on hv-cinder-84052 May 12 17:55:32.401749 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-915d95e5-d20e-4803-b541-92e8778dc0d2 req-e12ece59-32d4-4dcc-a59c-0cf1d7bd3e2e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111312 May 12 17:55:32.402335 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 493/1025] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:33.005467 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:33.006276 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:33.012861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:33.013313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:33.014079 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:33.014518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:33.145837 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:33.153631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-eb0142f3-3d28-4302-b151-eff846a29b2d tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.152143 May 12 17:55:33.154210 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 533/1026] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:33 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:34.172651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:34.173413 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:34.179382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:34.179884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:34.180670 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:34.181119 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:34.313603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:34.320731 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-1b57e241-cf7f-4536-a842-932ca231f122 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.152982 May 12 17:55:34.321291 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 494/1027] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:34 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:35.337991 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:35.338786 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:35.345145 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:35.345601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:35.346385 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:35.346828 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:35.471871 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:35.479751 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-616e7aa7-7f14-4595-a44f-4a8766086809 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.145651 May 12 17:55:35.480344 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 534/1028] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:35 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:36.497748 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:36.498440 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:36.505167 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:36.505568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:36.506615 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:36.507059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:36.637110 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:36.644568 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-45dc1ed4-e4d2-4566-844f-31db8d783d69 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.151601 May 12 17:55:36.645136 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 495/1029] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:36 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:37.661867 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:37.662484 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:37.669538 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:37.669995 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:37.670777 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:37.671220 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:37.801041 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:37.809106 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cfca0517-f0ca-44ff-b30d-42b79bf21b0f tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.151102 May 12 17:55:37.809687 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 535/1030] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:37 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:37.909772 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-3a3ace33-4117-49a2-86af-268286dea70c req-39e5da6b-061c-4abf-ab6b-919149c1cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b1547c-4ed6-4375-b636-8903a85c6b82", "name": "network-vif-plugged", "status": "completed", "tag": "627ccf4f-4b89-4327-a46b-2d57a4b45759"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:37.918727 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-3a3ace33-4117-49a2-86af-268286dea70c req-39e5da6b-061c-4abf-ab6b-919149c1cb01 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:37.919188 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-3a3ace33-4117-49a2-86af-268286dea70c req-39e5da6b-061c-4abf-ab6b-919149c1cb01 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:37.930119 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-3a3ace33-4117-49a2-86af-268286dea70c req-39e5da6b-061c-4abf-ab6b-919149c1cb01 service nova] Creating event network-vif-plugged:627ccf4f-4b89-4327-a46b-2d57a4b45759 for instance 30b1547c-4ed6-4375-b636-8903a85c6b82 on hv-cinder-84052 May 12 17:55:37.935630 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-3a3ace33-4117-49a2-86af-268286dea70c req-39e5da6b-061c-4abf-ab6b-919149c1cb01 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029557 May 12 17:55:37.936309 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 496/1031] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:38.826927 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:38.827544 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:38.833861 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:38.834329 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:38.835097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:38.835543 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:38.964743 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:38.971910 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ba374a9e-c498-4bab-a8df-8efa1043e9e5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1362 microversion: 2.1 time: 0.149879 May 12 17:55:38.972518 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 536/1032] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:38 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:39.990360 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:39.991059 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:39.997194 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:39.997647 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:39.998419 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:39.998863 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:40.126577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:55:40.134988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ec7739df-043a-4f1c-9c22-63a030600314 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1548 microversion: 2.1 time: 0.148796 May 12 17:55:40.135790 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 497/1033] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:55:39 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:55:40.152208 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:55:40.152716 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:55:40.159313 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:40.159792 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:40.160639 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:40.161083 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:40.237624 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-2fc3ce4d-318e-4e00-ac6b-87ace121ae07 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090174 May 12 17:55:40.238239 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 537/1034] 10.222.0.73 () {58 vars in 1274 bytes} [Thu May 12 17:55:40 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:55:41.200850 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-ee9e7774-3716-4191-8adf-c08d50997ea5 req-5d041972-c57e-47b1-a9fd-6240714002d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b1547c-4ed6-4375-b636-8903a85c6b82", "tag": "627ccf4f-4b89-4327-a46b-2d57a4b45759"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:55:41.209211 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-ee9e7774-3716-4191-8adf-c08d50997ea5 req-5d041972-c57e-47b1-a9fd-6240714002d4 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:55:41.209660 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-ee9e7774-3716-4191-8adf-c08d50997ea5 req-5d041972-c57e-47b1-a9fd-6240714002d4 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:55:41.221187 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-ee9e7774-3716-4191-8adf-c08d50997ea5 req-5d041972-c57e-47b1-a9fd-6240714002d4 service nova] Creating event network-changed:627ccf4f-4b89-4327-a46b-2d57a4b45759 for instance 30b1547c-4ed6-4375-b636-8903a85c6b82 on hv-cinder-84052 May 12 17:55:41.225966 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-ee9e7774-3716-4191-8adf-c08d50997ea5 req-5d041972-c57e-47b1-a9fd-6240714002d4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028917 May 12 17:55:41.227351 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 498/1035] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:17.477937 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:17.478547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:17.484808 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:17.485266 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:17.486041 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:17.486486 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:17.510877 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-5120d5cf-49f6-4eb4-a441-fd916fdbfed5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/ips" status: 200 len: 145 microversion: 2.1 time: 0.038048 May 12 17:56:17.511444 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 538/1036] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:56:17 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:18.823167 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c8a8ccb-6609-4184-876a-1ebfbf1f4435"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:18.824382 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:18.830941 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:18.831399 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:18.832189 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:18.832685 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:19.094940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ac9f9cde-c48e-4e4b-a6a9-9172e06b39e2 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276774 May 12 17:56:19.095547 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 499/1037] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:56:18 2022] POST /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:26.777202 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:26.778627 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:26.786086 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:26.786534 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:26.787474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:26.788667 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:26.826014 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-3cb3a4c6-c811-48a9-b4a0-929a0e230a73 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053667 May 12 17:56:26.826602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 539/1038] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:56:26 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:26.838242 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:26.839588 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:26.845204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:26.845815 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:26.846837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:26.847274 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:26.877127 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7331b7b8-c39a-42ed-8362-329240b8adb5 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/6c8a8ccb-6609-4184-876a-1ebfbf1f4435" status: 200 len: 194 microversion: 2.1 time: 0.043852 May 12 17:56:26.877652 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 500/1039] 10.222.0.73 () {58 vars in 1412 bytes} [Thu May 12 17:56:26 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/6c8a8ccb-6609-4184-876a-1ebfbf1f4435 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:28.023574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:28.026353 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:28.027433 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-5747aa54-8793-4654-8eab-3c91b4d798f1 req-b43afb7b-37fe-4f3d-9239-ffa9a255f7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:28.037127 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.038314 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.040262 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.041051 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.045203 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5747aa54-8793-4654-8eab-3c91b4d798f1 req-b43afb7b-37fe-4f3d-9239-ffa9a255f7b1 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.046121 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-5747aa54-8793-4654-8eab-3c91b4d798f1 req-b43afb7b-37fe-4f3d-9239-ffa9a255f7b1 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.061891 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-5747aa54-8793-4654-8eab-3c91b4d798f1 req-b43afb7b-37fe-4f3d-9239-ffa9a255f7b1 service nova] Creating event network-changed:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:56:28.072092 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-5747aa54-8793-4654-8eab-3c91b4d798f1 req-b43afb7b-37fe-4f3d-9239-ffa9a255f7b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049705 May 12 17:56:28.073870 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 501/1040] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:56:28.078828 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:56:28.170675 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-75e06c78-db55-4f17-9fe1-5b1c1240691e tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 204 len: 0 microversion: 2.1 time: 0.150587 May 12 17:56:28.175139 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 540/1041] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:28 2022] DELETE /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:56:28.181179 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:28.182232 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:28.189994 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.190650 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.192084 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.192867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.251832 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54f63b30-daed-45a9-88c8-aebcf6c7dde7"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:28.253264 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:28.261781 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.262809 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.263696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:28.264245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:28.353884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:28.364001 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-61e325b0-5dee-4993-880b-192ccb7acf64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.187246 May 12 17:56:28.364608 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 502/1042] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:28 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:29.062044 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:29.062639 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:29.068983 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.069717 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.070741 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.071320 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.102651 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Going to try to terminate instance {{(pid=123519) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:56:29.182782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c9040b6a-9262-4b33-a509-f87c39cc5745 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 204 len: 0 microversion: 2.1 time: 0.124598 May 12 17:56:29.183375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 503/1043] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:29 2022] DELETE /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 17:56:29.190074 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-09f41a34-106c-4b3c-870c-b13a10d7d83d req-e603cec3-11d7-4784-86c1-dc3ff0721abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03bed6f-d0ca-490a-a621-94a6938cfa83", "tag": "508b21df-7040-42d8-a984-3cff154f2c4e"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:29.198834 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-09f41a34-106c-4b3c-870c-b13a10d7d83d req-e603cec3-11d7-4784-86c1-dc3ff0721abf service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.199291 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-09f41a34-106c-4b3c-870c-b13a10d7d83d req-e603cec3-11d7-4784-86c1-dc3ff0721abf service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.210837 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-09f41a34-106c-4b3c-870c-b13a10d7d83d req-e603cec3-11d7-4784-86c1-dc3ff0721abf service nova] Creating event network-changed:508b21df-7040-42d8-a984-3cff154f2c4e for instance d03bed6f-d0ca-490a-a621-94a6938cfa83 on hv-cinder-84052 May 12 17:56:29.216874 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-09f41a34-106c-4b3c-870c-b13a10d7d83d req-e603cec3-11d7-4784-86c1-dc3ff0721abf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032241 May 12 17:56:29.217489 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 504/1044] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:29.222533 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:29.223233 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:29.230464 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.230927 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.231710 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.232151 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.379621 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:29.388774 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-31b601f8-4651-42b0-90eb-abc6df119e44 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1575 microversion: 2.1 time: 0.170188 May 12 17:56:29.389353 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 505/1045] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:29 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:29.393838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:29.394450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:29.401283 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.401851 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.402726 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:29.403177 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:29.547697 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:29.557732 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f38903f6-e454-4353-9b09-685d4acbfda9 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.166974 May 12 17:56:29.559164 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 506/1046] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:29 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:30.412295 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:30.413348 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:30.424308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:30.424976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:30.426146 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:30.426824 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:30.600147 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:30.609081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7aa5482d-7db3-49cd-8e92-ed540e25171b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1575 microversion: 2.1 time: 0.203545 May 12 17:56:30.609764 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 507/1047] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:30 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:56:30.615923 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:30.616877 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:30.626128 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:30.626688 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:30.627580 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:30.628123 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:30.793981 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:30.808235 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d2bb334c-5c93-4ffd-868e-4dbcc22f2314 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.196922 May 12 17:56:30.809234 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 508/1048] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:30 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:31.341953 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-201829a9-90b7-41f3-983b-12c805756b96 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "POST /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.095445 May 12 17:56:31.342693 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 541/1049] 10.222.0.73 () {60 vars in 1322 bytes} [Thu May 12 17:56:28 2022] POST /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments => generated 194 bytes in 3097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:56:31.635605 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:31.636766 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:31.643985 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:31.644473 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:31.645257 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:31.645704 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:31.835965 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:31.837909 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:31.851574 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:31.852905 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:31.854031 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:31.854746 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:31.977486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:31.986246 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ef9a0f95-2170-4558-ab1e-98a7daae57e6 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1575 microversion: 2.1 time: 0.356043 May 12 17:56:31.997094 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 509/1050] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:31 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1575 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:32.110562 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:32.120834 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-953f5ccf-b006-4c44-9a5c-dad860740124 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1570 microversion: 2.1 time: 0.289728 May 12 17:56:32.122068 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 542/1051] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:31 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1570 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:32.337437 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-8398ed57-597d-44c8-844c-1f7dcaf63214 req-c2f4ce25-5355-4772-b623-d15b8ce6c92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e980ad9a-20f5-4380-92ad-2e15e178af1b", "name": "network-vif-deleted", "tag": "36ac8c9b-649a-4f18-98d9-0e51a7a3795f"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:32.347871 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-8398ed57-597d-44c8-844c-1f7dcaf63214 req-c2f4ce25-5355-4772-b623-d15b8ce6c92b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:32.348867 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-8398ed57-597d-44c8-844c-1f7dcaf63214 req-c2f4ce25-5355-4772-b623-d15b8ce6c92b service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:32.361544 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-8398ed57-597d-44c8-844c-1f7dcaf63214 req-c2f4ce25-5355-4772-b623-d15b8ce6c92b service nova] Creating event network-vif-deleted:36ac8c9b-649a-4f18-98d9-0e51a7a3795f for instance e980ad9a-20f5-4380-92ad-2e15e178af1b on hv-cinder-84052 May 12 17:56:32.366753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-8398ed57-597d-44c8-844c-1f7dcaf63214 req-c2f4ce25-5355-4772-b623-d15b8ce6c92b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 May 12 17:56:32.367842 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 510/1052] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:32.553819 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-a29be238-9150-4d10-9231-6c29572c6808 req-30ed9286-750d-4656-a2d6-f7cba79a6807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03bed6f-d0ca-490a-a621-94a6938cfa83", "name": "network-vif-deleted", "tag": "508b21df-7040-42d8-a984-3cff154f2c4e"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:32.563393 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a29be238-9150-4d10-9231-6c29572c6808 req-30ed9286-750d-4656-a2d6-f7cba79a6807 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:32.563845 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-a29be238-9150-4d10-9231-6c29572c6808 req-30ed9286-750d-4656-a2d6-f7cba79a6807 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:32.575767 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-a29be238-9150-4d10-9231-6c29572c6808 req-30ed9286-750d-4656-a2d6-f7cba79a6807 service nova] Creating event network-vif-deleted:508b21df-7040-42d8-a984-3cff154f2c4e for instance d03bed6f-d0ca-490a-a621-94a6938cfa83 on hv-cinder-84052 May 12 17:56:32.581606 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-a29be238-9150-4d10-9231-6c29572c6808 req-30ed9286-750d-4656-a2d6-f7cba79a6807 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031550 May 12 17:56:32.582369 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 543/1053] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:33.005436 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:33.007254 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:33.012544 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:33.012998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:33.013801 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:33.014236 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:33.083342 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:33.092858 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-94595e20-464c-4eca-b94c-98d1a56cc1b7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 200 len: 1225 microversion: 2.1 time: 0.092558 May 12 17:56:33.093516 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 511/1054] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:32 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:33.140717 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:33.141476 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:33.149731 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:33.150305 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:33.151158 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:33.151594 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:33.188287 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:33.189267 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:33.189891 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lazy-loading 'fault' on Instance uuid e980ad9a-20f5-4380-92ad-2e15e178af1b {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:56:33.240439 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cee74fc982d4aa39f56c6b40de259cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583159e196b2438698885193ca03ef4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:33.252043 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a2b0492d-e464-4cb5-8e2e-556ca8da5e26 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 200 len: 1225 microversion: 2.1 time: 0.115799 May 12 17:56:33.252719 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 544/1055] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:33 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:34.110926 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:34.111481 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: d03bed6f-d0ca-490a-a621-94a6938cfa83] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:34.118345 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:34.118801 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:34.119564 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:34.119997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:34.133302 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] HTTP exception thrown: Instance d03bed6f-d0ca-490a-a621-94a6938cfa83 could not be found. May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Request method failure captured: May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 HTTP/1.1 May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUiq1wglIc3jVEdtxjcF7Qh17_E5H2azGrYqK5-pmxd_E68dTbRvqH5oFitEFHwqRac0BZ7Z-Ry3GuecsyWR4gscZ4nFreIrSJxh1o8Pp4QDLVqjltck18x2Dx-1Ij0JSd8lR9aY7g39BXF0D-LH4lvzHaqzcKxY6paE6JoF_P4RJuk May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:56:34.134940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a4d7ebeafe8140b3b8332059258a83eb", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: adbaa9b8b7e2447da5eef8f32aff22a1 May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance d03bed6f-d0ca-490a-a621-94a6938cfa83 could not be found. May 12 17:56:34.136640 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'd03bed6f-d0ca-490a-a621-94a6938cfa83'} May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03bed6f-d0ca-490a-a621-94a6938cfa83 could not be found. May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:34.137716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03bed6f-d0ca-490a-a621-94a6938cfa83 could not be found. May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03bed6f-d0ca-490a-a621-94a6938cfa83 could not be found. May 12 17:56:34.139301 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:34.140836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Returning 404 to user: Instance d03bed6f-d0ca-490a-a621-94a6938cfa83 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:34.140836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7196ce94-e6cd-4014-bbfe-374674b699cf tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83" status: 404 len: 111 microversion: 2.1 time: 0.029380 May 12 17:56:34.140836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 512/1056] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:34 2022] GET /compute/v2.1/servers/d03bed6f-d0ca-490a-a621-94a6938cfa83 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:34.270921 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:34.271678 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] [instance: e980ad9a-20f5-4380-92ad-2e15e178af1b] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:34.279215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:34.279686 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:34.280565 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:34.281013 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:34.294876 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] HTTP exception thrown: Instance e980ad9a-20f5-4380-92ad-2e15e178af1b could not be found. May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Request method failure captured: May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b HTTP/1.1 May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUk8LlWqNMH5mC_-8CBRgB_6LXXNJdlYwcJaHHimX8WrMtk6wkLUpJo_crJQms3WLZHUyDrdtHWhGA3zLTLdEFALxzIHaYLUikTeXDzyp8cbSOHsPFAcfP3qy5DGkDHyCGNfOGFUnwOhZZ4Gkj8rmgvYSSmdojdtyqgY0sz0VhOWw3g May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 583159e196b2438698885193ca03ef4d May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-TestShelveInstance-2015927117 May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:56:34.296589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/583159e196b2438698885193ca03ef4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/583159e196b2438698885193ca03ef4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/583159e196b2438698885193ca03ef4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_583159e196b2438698885193ca03ef4d", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-TestShelveInstance-2015927117 May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 583159e196b2438698885193ca03ef4d May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-TestShelveInstance-2015927117 May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-TestShelveInstance-2015927117-project May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 7cee74fc982d4aa39f56c6b40de259cc May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-TestShelveInstance-2015927117-project May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance e980ad9a-20f5-4380-92ad-2e15e178af1b could not be found. May 12 17:56:34.298245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'e980ad9a-20f5-4380-92ad-2e15e178af1b'} May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e980ad9a-20f5-4380-92ad-2e15e178af1b could not be found. May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:34.299214 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e980ad9a-20f5-4380-92ad-2e15e178af1b could not be found. May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e980ad9a-20f5-4380-92ad-2e15e178af1b could not be found. May 12 17:56:34.300530 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:34.301698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Returning 404 to user: Instance e980ad9a-20f5-4380-92ad-2e15e178af1b could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:34.301698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fd2fe6e7-0970-4d25-a13f-0d5fb7a13d64 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b" status: 404 len: 111 microversion: 2.1 time: 0.031425 May 12 17:56:34.301698 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 545/1057] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:34 2022] GET /compute/v2.1/servers/e980ad9a-20f5-4380-92ad-2e15e178af1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:34.465307 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-d0579a1e-3245-40b6-ae01-d048c2234c14 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] Calling method '.version_select at 0x7fc0c61da9d0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:34.490727 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-d0579a1e-3245-40b6-ae01-d048c2234c14 tempest-TestShelveInstance-2015927117 tempest-TestShelveInstance-2015927117-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1825969552" status: 202 len: 0 microversion: 2.1 time: 0.032620 May 12 17:56:34.492913 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 513/1058] 10.222.0.73 () {58 vars in 1253 bytes} [Thu May 12 17:56:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1825969552 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:56:37.310979 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [req-9e3e5069-ab1e-4edc-b022-8db32899abbb req-7d8f7c37-9891-4333-8b08-68cec6eefa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788626d2-eff4-4f02-980a-685cfb86b7c4", "tag": "32313048-9cf4-4080-982e-b807bb4c51d5"}]} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:37.313258 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:37.316631 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:37.330079 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9e3e5069-ab1e-4edc-b022-8db32899abbb req-7d8f7c37-9891-4333-8b08-68cec6eefa17 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:37.331643 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:37.332308 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:37.333494 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:37.334088 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:37.334706 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [req-9e3e5069-ab1e-4edc-b022-8db32899abbb req-7d8f7c37-9891-4333-8b08-68cec6eefa17 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:37.350048 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.compute.server_external_events [req-9e3e5069-ab1e-4edc-b022-8db32899abbb req-7d8f7c37-9891-4333-8b08-68cec6eefa17 service nova] Creating event network-changed:32313048-9cf4-4080-982e-b807bb4c51d5 for instance 788626d2-eff4-4f02-980a-685cfb86b7c4 on hv-cinder-84052 May 12 17:56:37.366450 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [req-9e3e5069-ab1e-4edc-b022-8db32899abbb req-7d8f7c37-9891-4333-8b08-68cec6eefa17 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059795 May 12 17:56:37.374627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 514/1059] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:37.380066 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:56:37.466253 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a634da6e-ac00-452e-86a8-9eb78eda4636 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 204 len: 0 microversion: 2.1 time: 0.163707 May 12 17:56:37.467310 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 546/1060] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:37 2022] DELETE /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:56:37.476157 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:37.477015 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:37.484997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:37.485757 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:37.486612 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:37.487573 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:37.667402 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:37.675252 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-7ea4281c-495c-4d55-a3bf-afd111c0f3bd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1576 microversion: 2.1 time: 0.203468 May 12 17:56:37.675769 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 515/1061] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:37 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:38.693467 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:38.694167 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:38.701030 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:38.701483 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:38.702261 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:38.702703 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:38.907547 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:38.918954 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-10c91d1d-9164-4cd0-bb7b-a8b4a07e3847 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1576 microversion: 2.1 time: 0.229592 May 12 17:56:38.919563 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 547/1062] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:38 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:39.935169 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:39.936463 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:39.951493 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:39.951695 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:39.953315 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:39.953782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:40.299238 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:40.314272 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-38055fbf-422f-4bdd-ac69-eeab32aef1fd tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1576 microversion: 2.1 time: 0.382808 May 12 17:56:40.316972 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 516/1063] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:39 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1576 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:40.965590 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-26f2c6a8-4a77-4496-b052-d7c69d37f48a req-cc20e5e0-e3aa-4e64-8933-f2ad187b0554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788626d2-eff4-4f02-980a-685cfb86b7c4", "name": "network-vif-deleted", "tag": "32313048-9cf4-4080-982e-b807bb4c51d5"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:40.975854 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-26f2c6a8-4a77-4496-b052-d7c69d37f48a req-cc20e5e0-e3aa-4e64-8933-f2ad187b0554 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:40.976946 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-26f2c6a8-4a77-4496-b052-d7c69d37f48a req-cc20e5e0-e3aa-4e64-8933-f2ad187b0554 service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:40.991516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-26f2c6a8-4a77-4496-b052-d7c69d37f48a req-cc20e5e0-e3aa-4e64-8933-f2ad187b0554 service nova] Creating event network-vif-deleted:32313048-9cf4-4080-982e-b807bb4c51d5 for instance 788626d2-eff4-4f02-980a-685cfb86b7c4 on hv-cinder-84052 May 12 17:56:40.998561 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-26f2c6a8-4a77-4496-b052-d7c69d37f48a req-cc20e5e0-e3aa-4e64-8933-f2ad187b0554 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037371 May 12 17:56:40.999433 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 548/1064] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:41.044156 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:41.045394 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:41.051940 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.052526 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.053502 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.054016 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.084900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8154a7db-7900-4d4a-9eed-58edb39cfb53 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046410 May 12 17:56:41.088198 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 517/1065] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:56:41 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:56:41.333894 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:41.334607 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:41.335482 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:41.336256 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:41.340924 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.341388 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.342187 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.342632 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.356381 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.356960 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.357811 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.361379 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.427062 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-435ac77b-e28e-40e8-a872-447339b8fb83 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/6c8a8ccb-6609-4184-876a-1ebfbf1f4435" status: 200 len: 194 microversion: 2.1 time: 0.095868 May 12 17:56:41.428386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 518/1066] 10.222.0.73 () {58 vars in 1412 bytes} [Thu May 12 17:56:41 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/6c8a8ccb-6609-4184-876a-1ebfbf1f4435 => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:41.441096 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:41.441917 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:41.458144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.458623 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.459461 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:41.459894 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:41.484694 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adbaa9b8b7e2447da5eef8f32aff22a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4d7ebeafe8140b3b8332059258a83eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:41.502074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c1cab700-d510-4977-89f6-06f6c70b923b tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 200 len: 1225 microversion: 2.1 time: 0.173417 May 12 17:56:41.503856 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 549/1067] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:41 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 17:56:41.603281 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lazy-loading 'services' on Instance uuid 30b1547c-4ed6-4375-b636-8903a85c6b82 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:56:41.698008 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e3afc725-88e3-45cc-8fce-602fb0b52841 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/6c8a8ccb-6609-4184-876a-1ebfbf1f4435" status: 202 len: 0 microversion: 2.1 time: 0.262961 May 12 17:56:41.699465 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 519/1068] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:56:41 2022] DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/6c8a8ccb-6609-4184-876a-1ebfbf1f4435 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 17:56:42.520427 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:42.521236 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 788626d2-eff4-4f02-980a-685cfb86b7c4] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:42.528477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:42.528942 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:42.529766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:42.530249 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:42.544457 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] HTTP exception thrown: Instance 788626d2-eff4-4f02-980a-685cfb86b7c4 could not be found. May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Request method failure captured: May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 HTTP/1.1 May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUiq1wglIc3jVEdtxjcF7Qh17_E5H2azGrYqK5-pmxd_E68dTbRvqH5oFitEFHwqRac0BZ7Z-Ry3GuecsyWR4gscZ4nFreIrSJxh1o8Pp4QDLVqjltck18x2Dx-1Ij0JSd8lR9aY7g39BXF0D-LH4lvzHaqzcKxY6paE6JoF_P4RJuk May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:56:42.546199 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a4d7ebeafe8140b3b8332059258a83eb", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: adbaa9b8b7e2447da5eef8f32aff22a1 May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 788626d2-eff4-4f02-980a-685cfb86b7c4 could not be found. May 12 17:56:42.547962 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '788626d2-eff4-4f02-980a-685cfb86b7c4'} May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788626d2-eff4-4f02-980a-685cfb86b7c4 could not be found. May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:42.548878 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788626d2-eff4-4f02-980a-685cfb86b7c4 could not be found. May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788626d2-eff4-4f02-980a-685cfb86b7c4 could not be found. May 12 17:56:42.550184 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:42.551328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Returning 404 to user: Instance 788626d2-eff4-4f02-980a-685cfb86b7c4 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:42.551328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c2501b12-bd05-4b99-8930-041bba85e91c tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4" status: 404 len: 111 microversion: 2.1 time: 0.031612 May 12 17:56:42.551328 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 550/1069] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:42 2022] GET /compute/v2.1/servers/788626d2-eff4-4f02-980a-685cfb86b7c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:43.066536 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:43.067334 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:43.075427 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.075884 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.077025 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.077470 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.103627 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] HTTP exception thrown: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Request method failure captured: May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 HTTP/1.1 May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUiq1wglIc3jVEdtxjcF7Qh17_E5H2azGrYqK5-pmxd_E68dTbRvqH5oFitEFHwqRac0BZ7Z-Ry3GuecsyWR4gscZ4nFreIrSJxh1o8Pp4QDLVqjltck18x2Dx-1Ij0JSd8lR9aY7g39BXF0D-LH4lvzHaqzcKxY6paE6JoF_P4RJuk May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:56:43.106297 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a4d7ebeafe8140b3b8332059258a83eb", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: adbaa9b8b7e2447da5eef8f32aff22a1 May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.108050 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '8e314313-1f60-4a9d-b9ef-f7bebb900128'} May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:43.109131 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.110679 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:43.112388 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Returning 404 to user: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:43.112998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-aea17765-b9f2-450a-b550-f3fe83d924be tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 404 len: 111 microversion: 2.1 time: 0.051577 May 12 17:56:43.116795 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 520/1070] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:43 2022] DELETE /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:43.123487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:43.124124 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] [instance: 8e314313-1f60-4a9d-b9ef-f7bebb900128] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:43.132502 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.132994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.133841 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.134373 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.149269 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] HTTP exception thrown: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Request method failure captured: May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 HTTP/1.1 May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUiq1wglIc3jVEdtxjcF7Qh17_E5H2azGrYqK5-pmxd_E68dTbRvqH5oFitEFHwqRac0BZ7Z-Ry3GuecsyWR4gscZ4nFreIrSJxh1o8Pp4QDLVqjltck18x2Dx-1Ij0JSd8lR9aY7g39BXF0D-LH4lvzHaqzcKxY6paE6JoF_P4RJuk May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:56:43.150987 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a4d7ebeafe8140b3b8332059258a83eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a4d7ebeafe8140b3b8332059258a83eb", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: a4d7ebeafe8140b3b8332059258a83eb May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-TestVolumeBootPattern-1201380070 May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: adbaa9b8b7e2447da5eef8f32aff22a1 May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-TestVolumeBootPattern-1201380070-project May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.152707 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '8e314313-1f60-4a9d-b9ef-f7bebb900128'} May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:43.153553 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. May 12 17:56:43.155120 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:43.156500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Returning 404 to user: Instance 8e314313-1f60-4a9d-b9ef-f7bebb900128 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:43.156500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-81e21cfd-8255-4f95-acef-a6b8d42118e2 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128" status: 404 len: 111 microversion: 2.1 time: 0.033485 May 12 17:56:43.156500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 551/1071] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:43 2022] GET /compute/v2.1/servers/8e314313-1f60-4a9d-b9ef-f7bebb900128 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:43.877004 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:43.877496 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:43.884141 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.884622 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.885395 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.885829 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.915244 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c56e306d-5056-4c87-970f-e3c436a9f461 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/54f63b30-daed-45a9-88c8-aebcf6c7dde7" status: 200 len: 194 microversion: 2.1 time: 0.041937 May 12 17:56:43.915836 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 521/1072] 10.222.0.73 () {58 vars in 1412 bytes} [Thu May 12 17:56:43 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/54f63b30-daed-45a9-88c8-aebcf6c7dde7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:43.925589 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:43.926094 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:43.932723 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.933173 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:43.933950 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:43.934387 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:44.018994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.objects.instance [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lazy-loading 'services' on Instance uuid 30b1547c-4ed6-4375-b636-8903a85c6b82 {{(pid=123520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:56:44.093456 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c06e157d-ae54-428c-a9f8-858347b39c8c tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/54f63b30-daed-45a9-88c8-aebcf6c7dde7" status: 202 len: 0 microversion: 2.1 time: 0.171542 May 12 17:56:44.094042 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 552/1073] 10.222.0.73 () {58 vars in 1415 bytes} [Thu May 12 17:56:43 2022] DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments/54f63b30-daed-45a9-88c8-aebcf6c7dde7 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:56:44.712144 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-57bfe9d3-97b9-4f03-b7ff-b049f9a42ff7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] Calling method '.version_select at 0x7fc0c6103f70>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:44.733564 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-57bfe9d3-97b9-4f03-b7ff-b049f9a42ff7 tempest-TestVolumeBootPattern-1201380070 tempest-TestVolumeBootPattern-1201380070-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1380938625" status: 202 len: 0 microversion: 2.1 time: 0.030286 May 12 17:56:44.734456 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 522/1074] 10.222.0.73 () {58 vars in 1262 bytes} [Thu May 12 17:56:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1380938625 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:56:45.278383 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:45.281363 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:45.290735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.291200 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.292001 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.292478 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.328017 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c440e824-8173-461a-940b-8a66257a1e38 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055234 May 12 17:56:45.328870 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 553/1075] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:56:45 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:56:45.445534 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:45.446753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:45.455370 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.456034 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.456915 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.458111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.488642 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-002ebab8-edd9-40e2-adb1-c4e14449ae3e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048179 May 12 17:56:45.489434 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 523/1076] 10.222.0.73 () {58 vars in 1301 bytes} [Thu May 12 17:56:45 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 17:56:45.549321 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:45.549824 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:45.560785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.561245 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.562052 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.562500 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.593619 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Going to try to terminate instance {{(pid=123520) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 17:56:45.685723 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f8bcc9c8-129a-482d-9908-57f852fcfe6e tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 204 len: 0 microversion: 2.1 time: 0.139719 May 12 17:56:45.686401 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 554/1077] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:45 2022] DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 17:56:45.696470 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:45.697097 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:45.704214 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.704781 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.705578 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:45.706018 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:45.888919 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:45.896603 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-bef783ad-f96e-454f-817a-fc2ad99808c9 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1672 microversion: 2.1 time: 0.204145 May 12 17:56:45.897392 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 524/1078] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:45 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:46.916186 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:46.917525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:46.924252 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:46.924704 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:46.925487 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:46.925922 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:47.070942 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.policy [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123520) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:47.078758 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-6f5226c1-51d6-4cdc-82f2-1d78bdb9028b tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1672 microversion: 2.1 time: 0.167697 May 12 17:56:47.086700 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 555/1079] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:46 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:48.097903 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:48.098703 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:48.113263 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:48.113734 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:48.114558 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:48.115000 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:48.707375 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:48.716931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-607028a6-a1f2-4c22-9b78-77145958ec16 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1672 microversion: 2.1 time: 0.623452 May 12 17:56:48.717857 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 525/1080] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:48 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1672 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:49.190291 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [req-092302ad-a2bd-4228-be4b-2271b9985fcf req-d6881533-87a6-4dc6-ad53-a4ff78f54bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b1547c-4ed6-4375-b636-8903a85c6b82", "name": "network-vif-deleted", "tag": "627ccf4f-4b89-4327-a46b-2d57a4b45759"}]} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:56:49.209132 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-092302ad-a2bd-4228-be4b-2271b9985fcf req-d6881533-87a6-4dc6-ad53-a4ff78f54bce service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:49.209615 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [req-092302ad-a2bd-4228-be4b-2271b9985fcf req-d6881533-87a6-4dc6-ad53-a4ff78f54bce service nova] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:49.223401 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.compute.server_external_events [req-092302ad-a2bd-4228-be4b-2271b9985fcf req-d6881533-87a6-4dc6-ad53-a4ff78f54bce service nova] Creating event network-vif-deleted:627ccf4f-4b89-4327-a46b-2d57a4b45759 for instance 30b1547c-4ed6-4375-b636-8903a85c6b82 on hv-cinder-84052 May 12 17:56:49.231376 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [req-092302ad-a2bd-4228-be4b-2271b9985fcf req-d6881533-87a6-4dc6-ad53-a4ff78f54bce service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044711 May 12 17:56:49.232003 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 556/1081] 10.222.0.73 () {64 vars in 1317 bytes} [Thu May 12 17:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:56:49.735524 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:49.736211 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:49.743107 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:49.743892 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:49.744753 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:49.745386 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:49.781976 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:49.782997 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:49.783706 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.objects.instance [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lazy-loading 'fault' on Instance uuid 30b1547c-4ed6-4375-b636-8903a85c6b82 {{(pid=123519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 17:56:49.832298 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.policy [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0ab664f7184cfd9bd6170e92512c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd17edf9c20f0426db1c8a1dbc420ed6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123519) authorize /opt/stack/nova/nova/policy.py:199}} May 12 17:56:49.843918 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-76bd31fd-05de-44e3-9e5e-0519023a6fb8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 200 len: 1327 microversion: 2.1 time: 0.112736 May 12 17:56:49.845970 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 526/1082] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:49 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 17:56:50.866970 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:50.868258 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:50.875722 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:50.876194 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:50.876968 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:50.877404 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:50.892640 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] HTTP exception thrown: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Request method failure captured: May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 HTTP/1.1 May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUlQrWahzVyo5spJ0f1PZ3r56zMf5Rhv_KrhTGPcXbadDBWx5Kb1LpUG78WipMlbKk_Rz85qKvoXSdzTtMr4xFzxppoEiBUS-ZhVSk7ihYq_OkdH6Wu_Pz3eqZigkFkAIQd3BsT02ehcOtDE3xuDJ3xTnDBSIWn1VdUMS9tPen1kuFw May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:56:50.894546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d17edf9c20f0426db1c8a1dbc420ed6c", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: bc0ab664f7184cfd9bd6170e92512c48 May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:50.896270 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '30b1547c-4ed6-4375-b636-8903a85c6b82'} May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:50.897443 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:50.899525 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:50.901842 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Returning 404 to user: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:50.902999 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f0cc2bf0-911c-4d45-b501-933cab55b4e7 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 404 len: 111 microversion: 2.1 time: 0.043733 May 12 17:56:50.907752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 557/1083] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:50 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:50.913486 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-f8b14ae6-9d2f-4195-a334-66018323dff4 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '.version_select at 0x7fc0c6052430>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:50.934081 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-f8b14ae6-9d2f-4195-a334-66018323dff4 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419871369" status: 202 len: 0 microversion: 2.1 time: 0.024453 May 12 17:56:50.934903 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 527/1084] 10.222.0.73 () {58 vars in 1217 bytes} [Thu May 12 17:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419871369 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:56:53.918050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:53.918662 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:53.924992 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:53.925446 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:53.926220 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:53.926663 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:53.940417 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] HTTP exception thrown: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Request method failure captured: May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 HTTP/1.1 May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUlQrWahzVyo5spJ0f1PZ3r56zMf5Rhv_KrhTGPcXbadDBWx5Kb1LpUG78WipMlbKk_Rz85qKvoXSdzTtMr4xFzxppoEiBUS-ZhVSk7ihYq_OkdH6Wu_Pz3eqZigkFkAIQd3BsT02ehcOtDE3xuDJ3xTnDBSIWn1VdUMS9tPen1kuFw May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:56:53.941994 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d17edf9c20f0426db1c8a1dbc420ed6c", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: bc0ab664f7184cfd9bd6170e92512c48 May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.943628 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '30b1547c-4ed6-4375-b636-8903a85c6b82'} May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:53.944497 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.945847 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:53.947074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Returning 404 to user: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:53.947074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-a9e45175-830f-43ff-9183-de658ee5fb90 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 404 len: 111 microversion: 2.1 time: 0.030221 May 12 17:56:53.947074 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 558/1085] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:53 2022] DELETE /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:53.952846 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:53.953543 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 30b1547c-4ed6-4375-b636-8903a85c6b82] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:53.959808 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:53.960300 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:53.961648 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:53.962089 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:53.980453 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] HTTP exception thrown: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Request method failure captured: May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 HTTP/1.1 May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUlQrWahzVyo5spJ0f1PZ3r56zMf5Rhv_KrhTGPcXbadDBWx5Kb1LpUG78WipMlbKk_Rz85qKvoXSdzTtMr4xFzxppoEiBUS-ZhVSk7ihYq_OkdH6Wu_Pz3eqZigkFkAIQd3BsT02ehcOtDE3xuDJ3xTnDBSIWn1VdUMS9tPen1kuFw May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:56:53.981989 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d17edf9c20f0426db1c8a1dbc420ed6c", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: bc0ab664f7184cfd9bd6170e92512c48 May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.983609 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '30b1547c-4ed6-4375-b636-8903a85c6b82'} May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:53.984515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. May 12 17:56:53.986054 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:53.987371 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Returning 404 to user: Instance 30b1547c-4ed6-4375-b636-8903a85c6b82 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:53.987371 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-c348942d-937c-4eee-82a1-d9405dce9004 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82" status: 404 len: 111 microversion: 2.1 time: 0.035095 May 12 17:56:53.987371 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 528/1086] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:53 2022] GET /compute/v2.1/servers/30b1547c-4ed6-4375-b636-8903a85c6b82 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:55.119439 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:55.119975 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.compute.api [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123520) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:55.126256 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:55.126735 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:55.127504 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:55.127942 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG oslo_concurrency.lockutils [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:55.143034 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] HTTP exception thrown: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Request method failure captured: May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 HTTP/1.1 May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUlQrWahzVyo5spJ0f1PZ3r56zMf5Rhv_KrhTGPcXbadDBWx5Kb1LpUG78WipMlbKk_Rz85qKvoXSdzTtMr4xFzxppoEiBUS-ZhVSk7ihYq_OkdH6Wu_Pz3eqZigkFkAIQd3BsT02ehcOtDE3xuDJ3xTnDBSIWn1VdUMS9tPen1kuFw May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:56:55.144625 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d17edf9c20f0426db1c8a1dbc420ed6c", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: bc0ab664f7184cfd9bd6170e92512c48 May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: > May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.146602 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '3f2dcfe1-505b-479b-adee-02927130d745'} May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:55.147689 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.150050 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:56:55.151593 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Returning 404 to user: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:55.151593 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4aebd844-0513-4ac8-af34-c907c17f45f8 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 404 len: 111 microversion: 2.1 time: 0.031305 May 12 17:56:55.151593 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 559/1087] 10.222.0.73 () {58 vars in 1238 bytes} [Thu May 12 17:56:55 2022] DELETE /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:55.155113 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Calling method '>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:56:55.155729 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.compute.api [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] [instance: 3f2dcfe1-505b-479b-adee-02927130d745] Fetching instance by UUID {{(pid=123519) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 17:56:55.161998 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:55.162436 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:55.163204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 17:56:55.163726 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG oslo_concurrency.lockutils [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Lock "df6b1b6b-5b14-4ab0-a5af-bdfc783bfef3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 17:56:55.176935 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] HTTP exception thrown: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Request method failure captured: May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 HTTP/1.1 May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUlQrWahzVyo5spJ0f1PZ3r56zMf5Rhv_KrhTGPcXbadDBWx5Kb1LpUG78WipMlbKk_Rz85qKvoXSdzTtMr4xFzxppoEiBUS-ZhVSk7ihYq_OkdH6Wu_Pz3eqZigkFkAIQd3BsT02ehcOtDE3xuDJ3xTnDBSIWn1VdUMS9tPen1kuFw May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:56:55.178515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d17edf9c20f0426db1c8a1dbc420ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d17edf9c20f0426db1c8a1dbc420ed6c", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: d17edf9c20f0426db1c8a1dbc420ed6c May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2142373135 May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: bc0ab664f7184cfd9bd6170e92512c48 May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-AttachVolumeTestJSON-2142373135-project May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: > May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.180279 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '3f2dcfe1-505b-479b-adee-02927130d745'} May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:56:55.181338 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. May 12 17:56:55.182967 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:56:55.184515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] Returning 404 to user: Instance 3f2dcfe1-505b-479b-adee-02927130d745 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:56:55.184515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-daec0a24-2eb4-4c7e-9890-55e62a759fb6 tempest-AttachVolumeTestJSON-2142373135 tempest-AttachVolumeTestJSON-2142373135-project] 10.222.0.73 "GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745" status: 404 len: 111 microversion: 2.1 time: 0.028764 May 12 17:56:55.184515 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 529/1088] 10.222.0.73 () {58 vars in 1235 bytes} [Thu May 12 17:56:55 2022] GET /compute/v2.1/servers/3f2dcfe1-505b-479b-adee-02927130d745 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:56:59.997874 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-ca602a1d-cb2f-4147-b72b-01e86d9ca1ab tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Action: 'create', calling method: .version_select at 0x7fc0c5901b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1326073866"}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:57:00.284040 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-ca602a1d-cb2f-4147-b72b-01e86d9ca1ab tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.446394 May 12 17:57:00.285012 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 560/1089] 10.222.0.73 () {60 vars in 1154 bytes} [Thu May 12 17:56:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 448 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 17:57:00.297296 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-837f12ef-5790-41cf-b880-05ba73ae398b tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c619a280>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:00.349662 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-837f12ef-5790-41cf-b880-05ba73ae398b tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 200 len: 345 microversion: 2.1 time: 0.057361 May 12 17:57:00.350221 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 530/1090] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:57:00 2022] GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:01.363718 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fb2f4e59-de56-4774-882e-ee7ffdc887d7 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c596da60>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:01.410181 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fb2f4e59-de56-4774-882e-ee7ffdc887d7 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 200 len: 346 microversion: 2.1 time: 0.050664 May 12 17:57:01.410754 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 561/1091] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:57:01 2022] GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:01.423022 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-af0bc2d5-afa4-4cb5-aa8d-ac348717e63e tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Action: 'create', calling method: .version_select at 0x7fc0c60520d0>, body: {"snapshot": {"volume_id": "241745e1-32e1-4f9d-91b0-fa3933ccc0d9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-316188573"}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:57:01.568673 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-af0bc2d5-afa4-4cb5-aa8d-ac348717e63e tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.149903 May 12 17:57:01.569339 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 531/1092] 10.222.0.73 () {60 vars in 1161 bytes} [Thu May 12 17:57:01 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:57:01.580327 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-0401e0da-cc24-4237-9567-5451004104f5 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c591a790>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:01.611508 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-0401e0da-cc24-4237-9567-5451004104f5 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 200 len: 286 microversion: 2.1 time: 0.035522 May 12 17:57:01.612090 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 562/1093] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:01 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:01.622883 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-70ffe803-3760-4e05-bcf4-f8accd38729f tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c619a790>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:01.652721 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-70ffe803-3760-4e05-bcf4-f8accd38729f tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033671 May 12 17:57:01.653286 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 532/1094] 10.222.0.73 () {58 vars in 1139 bytes} [Thu May 12 17:57:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:57:01.665477 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-4defda88-4f15-4ae3-a91d-0cebf91a348b tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c5901700>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:01.694024 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-4defda88-4f15-4ae3-a91d-0cebf91a348b tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 200 len: 286 microversion: 2.1 time: 0.033447 May 12 17:57:01.695144 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 563/1095] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:01 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:02.707057 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-e5a967b8-b8bd-4db5-b9aa-74d0f7394999 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c61da9d0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:02.736229 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-e5a967b8-b8bd-4db5-b9aa-74d0f7394999 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 200 len: 286 microversion: 2.1 time: 0.033385 May 12 17:57:02.736782 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 533/1096] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:02 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:03.749109 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-c5fe4f29-b8f4-48d8-9bc0-e98089817280 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c590f4c0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:03.781215 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-c5fe4f29-b8f4-48d8-9bc0-e98089817280 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 200 len: 286 microversion: 2.1 time: 0.036332 May 12 17:57:03.781776 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 564/1097] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:03 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:04.794401 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-0131eb84-95ba-4f09-9a0e-2be403944c8c tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0cb36dc10>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:04.824408 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-0131eb84-95ba-4f09-9a0e-2be403944c8c tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 200 len: 287 microversion: 2.1 time: 0.034468 May 12 17:57:04.824996 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 534/1098] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:04 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:04.835996 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-7605c1ba-a875-432d-9040-c575341c7518 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c591a790>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:04.893662 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-7605c1ba-a875-432d-9040-c575341c7518 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 202 len: 0 microversion: 2.1 time: 0.061930 May 12 17:57:04.894365 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 565/1099] 10.222.0.73 () {58 vars in 1253 bytes} [Thu May 12 17:57:04 2022] DELETE /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:57:04.903754 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8dcc7d61-5aaa-4a24-adbc-a7aeda7b2cb9 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c61daee0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:04.933064 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8dcc7d61-5aaa-4a24-adbc-a7aeda7b2cb9 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 200 len: 286 microversion: 2.1 time: 0.033216 May 12 17:57:04.933637 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 535/1100] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:04 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 17:57:05.945180 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8808e825-6c33-4de4-a4a8-fd8b72020a66 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0cb278ca0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:05.973318 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-8808e825-6c33-4de4-a4a8-fd8b72020a66 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] HTTP exception thrown: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8808e825-6c33-4de4-a4a8-fd8b72020a66 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Request method failure captured: May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 HTTP/1.1 May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUprDZmN0pszJ0cgvNHKmOVJd8Jvl8zahXI_rW-EQo6naWhjxEjQztPfU6uTomAQsdhaHIQpsLeLJ1ZHrt069RxJZH7vNJoQ3D57FO5jcl1N_L86Ewju7hVqAWCQMCGbcbj8WrFtdIVaGzmrk25tSKoy8EFhpG4We718uRF-USTH-hg May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:57:05.975516 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e5dcc1fb7244096909161967f9a9d74", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: d36b96cf14cb4a5d9e75f14f237082d5 May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': 'c9e51758-1c43-4668-867e-02e78db1cd12'} May 12 17:57:05.977984 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. (HTTP 404) (Request-ID: req-de8b7456-b632-4095-a4d5-c809e3e965a4) May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.979105 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:05.980752 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 17:57:05.982474 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-8808e825-6c33-4de4-a4a8-fd8b72020a66 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Returning 404 to user: Snapshot c9e51758-1c43-4668-867e-02e78db1cd12 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:05.984097 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-8808e825-6c33-4de4-a4a8-fd8b72020a66 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12" status: 404 len: 111 microversion: 2.1 time: 0.037592 May 12 17:57:05.985232 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 566/1101] 10.222.0.73 () {58 vars in 1250 bytes} [Thu May 12 17:57:05 2022] GET /compute/v2.1/os-snapshots/c9e51758-1c43-4668-867e-02e78db1cd12 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:57:05.988931 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-69f7828d-b01a-40d9-9df8-31e4c6acd6d6 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0cb3184c0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:06.056333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-69f7828d-b01a-40d9-9df8-31e4c6acd6d6 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 202 len: 0 microversion: 2.1 time: 0.072768 May 12 17:57:06.056910 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 536/1102] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:57:05 2022] DELETE /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 17:57:06.066983 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-604a1a63-f26c-4aca-b305-c5d89dd4438b tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0cb2784c0>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:06.123235 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-604a1a63-f26c-4aca-b305-c5d89dd4438b tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 200 len: 345 microversion: 2.1 time: 0.061183 May 12 17:57:06.123800 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 567/1103] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:57:06 2022] GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 17:57:07.141814 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3b62c574-d378-4913-aed9-acb0b6d869c0 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c619a160>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:07.172361 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-3b62c574-d378-4913-aed9-acb0b6d869c0 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] HTTP exception thrown: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3b62c574-d378-4913-aed9-acb0b6d869c0 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Request method failure captured: May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 HTTP/1.1 May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUprDZmN0pszJ0cgvNHKmOVJd8Jvl8zahXI_rW-EQo6naWhjxEjQztPfU6uTomAQsdhaHIQpsLeLJ1ZHrt069RxJZH7vNJoQ3D57FO5jcl1N_L86Ewju7hVqAWCQMCGbcbj8WrFtdIVaGzmrk25tSKoy8EFhpG4We718uRF-USTH-hg May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:57:07.175975 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e5dcc1fb7244096909161967f9a9d74", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: d36b96cf14cb4a5d9e75f14f237082d5 May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '241745e1-32e1-4f9d-91b0-fa3933ccc0d9'} May 12 17:57:07.177683 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. (HTTP 404) (Request-ID: req-a29b04c9-9d91-4f56-b0f1-139154263c3e) May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.178838 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:07.181104 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:57:07.182624 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-3b62c574-d378-4913-aed9-acb0b6d869c0 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Returning 404 to user: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-3b62c574-d378-4913-aed9-acb0b6d869c0 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 404 len: 109 microversion: 2.1 time: 0.044526 May 12 17:57:07.184186 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 537/1104] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:57:07 2022] GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:57:07.191281 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fa81c07b-d0f6-46d1-b6a9-ca80f42e011a tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c596d940>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:07.222960 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-fa81c07b-d0f6-46d1-b6a9-ca80f42e011a tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] HTTP exception thrown: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fa81c07b-d0f6-46d1-b6a9-ca80f42e011a tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Request method failure captured: May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 HTTP/1.1 May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUprDZmN0pszJ0cgvNHKmOVJd8Jvl8zahXI_rW-EQo6naWhjxEjQztPfU6uTomAQsdhaHIQpsLeLJ1ZHrt069RxJZH7vNJoQ3D57FO5jcl1N_L86Ewju7hVqAWCQMCGbcbj8WrFtdIVaGzmrk25tSKoy8EFhpG4We718uRF-USTH-hg May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:57:07.225601 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e5dcc1fb7244096909161967f9a9d74", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: d36b96cf14cb4a5d9e75f14f237082d5 May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '241745e1-32e1-4f9d-91b0-fa3933ccc0d9'} May 12 17:57:07.228890 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. (HTTP 404) (Request-ID: req-33ceeaf4-6d6a-46d9-ae4a-bc9ac67fdf91) May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.230614 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:57:07.232821 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:57:07.234785 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-fa81c07b-d0f6-46d1-b6a9-ca80f42e011a tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Returning 404 to user: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:07.236451 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-fa81c07b-d0f6-46d1-b6a9-ca80f42e011a tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 404 len: 109 microversion: 2.1 time: 0.042998 May 12 17:57:07.237533 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 568/1105] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:57:07 2022] DELETE /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:57:07.250506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ad43e8eb-3953-4884-bdf8-5c1e4a251493 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Calling method '.version_select at 0x7fc0c619a790>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:07.283886 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-ad43e8eb-3953-4884-bdf8-5c1e4a251493 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] HTTP exception thrown: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ad43e8eb-3953-4884-bdf8-5c1e4a251493 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Request method failure captured: May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 HTTP/1.1 May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUprDZmN0pszJ0cgvNHKmOVJd8Jvl8zahXI_rW-EQo6naWhjxEjQztPfU6uTomAQsdhaHIQpsLeLJ1ZHrt069RxJZH7vNJoQ3D57FO5jcl1N_L86Ewju7hVqAWCQMCGbcbj8WrFtdIVaGzmrk25tSKoy8EFhpG4We718uRF-USTH-hg May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:57:07.286925 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1e5dcc1fb7244096909161967f9a9d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1e5dcc1fb7244096909161967f9a9d74", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 1e5dcc1fb7244096909161967f9a9d74 May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1827769679 May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: d36b96cf14cb4a5d9e75f14f237082d5 May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1827769679-project May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '241745e1-32e1-4f9d-91b0-fa3933ccc0d9'} May 12 17:57:07.289333 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. (HTTP 404) (Request-ID: req-4053b67f-d5c5-483a-b41e-be499bbcaf0c) May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.290204 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:07.291383 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:57:07.292666 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-ad43e8eb-3953-4884-bdf8-5c1e4a251493 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] Returning 404 to user: Volume 241745e1-32e1-4f9d-91b0-fa3933ccc0d9 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-ad43e8eb-3953-4884-bdf8-5c1e4a251493 tempest-VolumesSnapshotsTestJSON-1827769679 tempest-VolumesSnapshotsTestJSON-1827769679-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9" status: 404 len: 109 microversion: 2.1 time: 0.043526 May 12 17:57:07.293900 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 538/1106] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:57:07 2022] GET /compute/v2.1/os-volumes/241745e1-32e1-4f9d-91b0-fa3933ccc0d9 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:57:09.001681 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-72914d8c-d1b8-464f-9806-378130a90377 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Action: 'create', calling method: .version_select at 0x7fc0c596d160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1180787568", "metadata": {"Type": "work"}}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-72914d8c-d1b8-464f-9806-378130a90377 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Request method failure captured: May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 122 May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUp0ZJBIS41ulLrTM7QM0IieoNsxP9Q8O5ghzMCHyTZAll89T0nIZ0XYw0sc_Z1G_f5jD1cNoqQkV2LknPN5n23-t3RWLt5sxn3_-sSzjLq1elWCqpc-j35aZVVl_eAZwjpvU8eDQ2vlgElKr2U9XhLPbwW9lgWSELCzTi8mX-48rDQ May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:57:09.010464 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51a94e5b3e8f4870af4088d6cde36351", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 35f207aa21c94d93aafe89c38f7d7223 May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1180787568", "metadata": {"Type": "work"}}} May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: May 12 17:57:09.012737 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1180787568', 'metadata': {'Type': 'work'}}}} May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise error May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi '#$%' May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:09.014159 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:57:09.015720 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:57:09.017331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 17:57:09.017331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.017331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-72914d8c-d1b8-464f-9806-378130a90377 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:09.017331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-72914d8c-d1b8-464f-9806-378130a90377 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129906 May 12 17:57:09.017331 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 569/1107] 10.222.0.73 () {60 vars in 1155 bytes} [Thu May 12 17:57:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:57:09.023577 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-96104a91-ce52-4dc4-b0e9-2d9f4412733c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Action: 'create', calling method: .version_select at 0x7fc0c61035e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-380590041", "metadata": {"Type": "work"}}} {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-96104a91-ce52-4dc4-b0e9-2d9f4412733c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Request method failure captured: May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 119 May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUp0ZJBIS41ulLrTM7QM0IieoNsxP9Q8O5ghzMCHyTZAll89T0nIZ0XYw0sc_Z1G_f5jD1cNoqQkV2LknPN5n23-t3RWLt5sxn3_-sSzjLq1elWCqpc-j35aZVVl_eAZwjpvU8eDQ2vlgElKr2U9XhLPbwW9lgWSELCzTi8mX-48rDQ May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:57:09.026756 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51a94e5b3e8f4870af4088d6cde36351", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 35f207aa21c94d93aafe89c38f7d7223 May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-380590041", "metadata": {"Type": "work"}}} May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: May 12 17:57:09.028752 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-380590041', 'metadata': {'Type': 'work'}}}} May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise error May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi '0' May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:09.030209 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:57:09.031988 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:57:09.033716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 17:57:09.033716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.033716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-96104a91-ce52-4dc4-b0e9-2d9f4412733c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:09.033716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-96104a91-ce52-4dc4-b0e9-2d9f4412733c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009789 May 12 17:57:09.033716 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 539/1108] 10.222.0.73 () {60 vars in 1155 bytes} [Thu May 12 17:57:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:57:09.038619 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cf91f2c4-3887-4f2a-98c2-14f7aca880d0 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Action: 'create', calling method: .version_select at 0x7fc0cb278940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-4213498", "metadata": {"Type": "work"}}} {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cf91f2c4-3887-4f2a-98c2-14f7aca880d0 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Request method failure captured: May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 116 May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUp0ZJBIS41ulLrTM7QM0IieoNsxP9Q8O5ghzMCHyTZAll89T0nIZ0XYw0sc_Z1G_f5jD1cNoqQkV2LknPN5n23-t3RWLt5sxn3_-sSzjLq1elWCqpc-j35aZVVl_eAZwjpvU8eDQ2vlgElKr2U9XhLPbwW9lgWSELCzTi8mX-48rDQ May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:57:09.040945 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51a94e5b3e8f4870af4088d6cde36351", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 35f207aa21c94d93aafe89c38f7d7223 May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-4213498", "metadata": {"Type": "work"}}} May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: May 12 17:57:09.043223 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-4213498', 'metadata': {'Type': 'work'}}}} May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise error May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi '' May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:09.044725 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 17:57:09.047035 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 17:57:09.048696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 17:57:09.048696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.048696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-cf91f2c4-3887-4f2a-98c2-14f7aca880d0 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:09.048696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-cf91f2c4-3887-4f2a-98c2-14f7aca880d0 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007527 May 12 17:57:09.048696 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 570/1109] 10.222.0.73 () {60 vars in 1155 bytes} [Thu May 12 17:57:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 17:57:09.052722 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65d33e8a-3ec7-4219-9045-203cddd8ae00 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Calling method '.version_select at 0x7fc0c61a2160>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:09.082255 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-65d33e8a-3ec7-4219-9045-203cddd8ae00 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] HTTP exception thrown: Volume tempest-invalid-2110623307 could not be found. May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65d33e8a-3ec7-4219-9045-203cddd8ae00 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Request method failure captured: May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2110623307 HTTP/1.1 May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUp0ZJBIS41ulLrTM7QM0IieoNsxP9Q8O5ghzMCHyTZAll89T0nIZ0XYw0sc_Z1G_f5jD1cNoqQkV2LknPN5n23-t3RWLt5sxn3_-sSzjLq1elWCqpc-j35aZVVl_eAZwjpvU8eDQ2vlgElKr2U9XhLPbwW9lgWSELCzTi8mX-48rDQ May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:57:09.084560 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51a94e5b3e8f4870af4088d6cde36351", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 35f207aa21c94d93aafe89c38f7d7223 May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Volume tempest-invalid-2110623307 could not be found. May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': 'tempest-invalid-2110623307'} May 12 17:57:09.087308 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2110623307 could not be found. (HTTP 404) (Request-ID: req-a7c84f61-e466-4818-bb86-2a3af44a30f3) May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.088404 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:57:09.089758 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2110623307 could not be found. May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:09.091415 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2110623307 could not be found. May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2110623307 could not be found. May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-65d33e8a-3ec7-4219-9045-203cddd8ae00 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Returning 404 to user: Volume tempest-invalid-2110623307 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-65d33e8a-3ec7-4219-9045-203cddd8ae00 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2110623307" status: 404 len: 99 microversion: 2.1 time: 0.038069 May 12 17:57:09.093103 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 540/1110] 10.222.0.73 () {58 vars in 1217 bytes} [Thu May 12 17:57:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2110623307 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 17:57:09.097585 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-88315307-efa4-4107-ae5c-9b84491ef83d tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005123 May 12 17:57:09.098148 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 571/1111] 10.222.0.73 () {58 vars in 1139 bytes} [Thu May 12 17:57:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 17:57:09.112995 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-b9cc3b09-7c04-4943-8aa9-4ffce3eec7ac tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006453 May 12 17:57:09.113506 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 541/1112] 10.222.0.73 () {58 vars in 1136 bytes} [Thu May 12 17:57:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 17:57:09.122823 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3f653c6-f385-42c9-bc52-373350e3e147 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Calling method '.version_select at 0x7fc0cb1bc940>' {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:09.153524 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.wsgi [None req-f3f653c6-f385-42c9-bc52-373350e3e147 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] HTTP exception thrown: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3f653c6-f385-42c9-bc52-373350e3e147 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Request method failure captured: May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: request: DELETE /compute/v2.1/os-volumes/54b08a91-1ec2-4e4d-941d-85dfd386a369 HTTP/1.1 May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept: application/json May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Accept-Encoding: identity May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Connection: close May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Length: 0 May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Content-Type: application/json May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Host: 10.222.0.73 May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Openstack-System-Scope: None May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: User-Agent: python-urllib3/1.26.9 May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Auth-Token: gAAAAABifUp0ZJBIS41ulLrTM7QM0IieoNsxP9Q8O5ghzMCHyTZAll89T0nIZ0XYw0sc_Z1G_f5jD1cNoqQkV2LknPN5n23-t3RWLt5sxn3_-sSzjLq1elWCqpc-j35aZVVl_eAZwjpvU8eDQ2vlgElKr2U9XhLPbwW9lgWSELCzTi8mX-48rDQ May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Id: None May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Domain-Name: None May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Identity-Status: Confirmed May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Is-Admin-Project: True May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Id: default May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Domain-Name: Default May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Project-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Role: reader,member May 12 17:57:09.155481 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Roles: reader,member May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51a94e5b3e8f4870af4088d6cde36351", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-Tenant-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Id: default May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Domain-Name: Default May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Id: 35f207aa21c94d93aafe89c38f7d7223 May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: X-User-Name: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: method: May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: exception: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: action_args: {'id': '54b08a91-1ec2-4e4d-941d-85dfd386a369'} May 12 17:57:09.157146 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: {{(pid=123520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. (HTTP 404) (Request-ID: req-08d69de5-e3b2-4fa9-abfd-d8601a33bfdb) May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.158204 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 17:57:09.159766 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 17:57:09.161312 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: ERROR nova.api.openstack.wsgi May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: DEBUG nova.api.openstack.wsgi [None req-f3f653c6-f385-42c9-bc52-373350e3e147 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Returning 404 to user: Volume 54b08a91-1ec2-4e4d-941d-85dfd386a369 could not be found. {{(pid=123520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO nova.api.openstack.requestlog [None req-f3f653c6-f385-42c9-bc52-373350e3e147 tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/54b08a91-1ec2-4e4d-941d-85dfd386a369" status: 404 len: 109 microversion: 2.1 time: 0.037909 May 12 17:57:09.162759 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: [pid: 123520|app: 0|req: 572/1113] 10.222.0.73 () {58 vars in 1247 bytes} [Thu May 12 17:57:09 2022] DELETE /compute/v2.1/os-volumes/54b08a91-1ec2-4e4d-941d-85dfd386a369 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:57:09.171987 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d5d7970-b2c5-4d9f-8a57-39bb081c758c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Calling method '.version_select at 0x7fc0c60065e0>' {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 17:57:09.200452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.wsgi [None req-8d5d7970-b2c5-4d9f-8a57-39bb081c758c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] HTTP exception thrown: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d5d7970-b2c5-4d9f-8a57-39bb081c758c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Request method failure captured: May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: request: GET /compute/v2.1/os-volumes/5cb182a5-169e-4489-ad9d-015350bd39c0 HTTP/1.1 May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept: application/json May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Accept-Encoding: identity May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Connection: close May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Length: 0 May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Content-Type: application/json May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Host: 10.222.0.73 May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Openstack-System-Scope: None May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: User-Agent: python-urllib3/1.26.9 May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Auth-Token: gAAAAABifUp0ZJBIS41ulLrTM7QM0IieoNsxP9Q8O5ghzMCHyTZAll89T0nIZ0XYw0sc_Z1G_f5jD1cNoqQkV2LknPN5n23-t3RWLt5sxn3_-sSzjLq1elWCqpc-j35aZVVl_eAZwjpvU8eDQ2vlgElKr2U9XhLPbwW9lgWSELCzTi8mX-48rDQ May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Id: None May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Domain-Name: None May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Identity-Status: Confirmed May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Is-Admin-Project: True May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Id: default May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Domain-Name: Default May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Project-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Role: reader,member May 12 17:57:09.202390 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Roles: reader,member May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51a94e5b3e8f4870af4088d6cde36351"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51a94e5b3e8f4870af4088d6cde36351", "adminURL": "http://10.222.0.73:8080"}]}] May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Id: 51a94e5b3e8f4870af4088d6cde36351 May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-Tenant-Name: tempest-VolumesNegativeTest-1236277316 May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Id: default May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Domain-Name: Default May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Id: 35f207aa21c94d93aafe89c38f7d7223 May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: X-User-Name: tempest-VolumesNegativeTest-1236277316-project May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: method: May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: exception: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: action_args: {'id': '5cb182a5-169e-4489-ad9d-015350bd39c0'} May 12 17:57:09.204039 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: {{(pid=123519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. (HTTP 404) (Request-ID: req-d591d0e9-f21a-42fe-add0-b2c7a1d5e739) May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.205111 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 17:57:09.206675 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 17:57:09.208120 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: ERROR nova.api.openstack.wsgi May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: DEBUG nova.api.openstack.wsgi [None req-8d5d7970-b2c5-4d9f-8a57-39bb081c758c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] Returning 404 to user: Volume 5cb182a5-169e-4489-ad9d-015350bd39c0 could not be found. {{(pid=123519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO nova.api.openstack.requestlog [None req-8d5d7970-b2c5-4d9f-8a57-39bb081c758c tempest-VolumesNegativeTest-1236277316 tempest-VolumesNegativeTest-1236277316-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/5cb182a5-169e-4489-ad9d-015350bd39c0" status: 404 len: 109 microversion: 2.1 time: 0.036455 May 12 17:57:09.209582 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: [pid: 123519|app: 0|req: 542/1114] 10.222.0.73 () {58 vars in 1244 bytes} [Thu May 12 17:57:09 2022] GET /compute/v2.1/os-volumes/5cb182a5-169e-4489-ad9d-015350bd39c0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 17:58:20.420762 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:58:20.421484 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Thu May 12 17:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 17:58:34.405630 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 17:58:34.406248 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Thu May 12 17:58:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 18:00:09.069452 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 18:00:09.070163 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Thu May 12 18:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 18:00:20.777546 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 18:00:20.778175 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Thu May 12 18:00:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 18:01:40.429027 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 18:01:40.429692 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Thu May 12 18:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 18:01:54.413977 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 18:01:54.414579 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Thu May 12 18:01:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 18:01:56.127688 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 18:01:56.128425 dv-cinder-840525-2-iscsi devstack@n-api.service[123520]: Thu May 12 18:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 18:02:08.221616 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 18:02:08.222256 dv-cinder-840525-2-iscsi devstack@n-api.service[123519]: Thu May 12 18:02:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!